-- Logs begin at Wed 2022-01-26 18:45:41 UTC, end at Wed 2022-01-26 19:45:11 UTC. -- Jan 26 19:16:39.743578 dv-cinder-794001-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 26 19:16:39.750739 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 26 19:16:39 2022] *** Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: nodename: dv-cinder-794001-3-iscsi Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: machine: x86_64 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: clock source: unix Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: pcre jit disabled Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: detected number of CPU cores: 4 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: current working directory: / Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: detected binary path: /usr/bin/uwsgi-core Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: your processes number limit is 47680 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: your memory page size is 4096 bytes Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: detected max file descriptor number: 2048 Jan 26 19:16:39.753922 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: lock engine: pthread robust mutexes Jan 26 19:16:39.754704 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: thunder lock: enabled Jan 26 19:16:39.754704 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 26 19:16:39.754704 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 26 19:16:39.799137 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: Python main interpreter initialized at 0x5557f63e99c0 Jan 26 19:16:39.799137 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: python threads support enabled Jan 26 19:16:39.799137 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: your server socket listen backlog is limited to 100 connections Jan 26 19:16:39.799137 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: your mercy for graceful operations on workers is 90 seconds Jan 26 19:16:39.799477 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: mapped 403077 bytes (393 KB) for 2 cores Jan 26 19:16:39.799563 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: *** Operational MODE: preforking *** Jan 26 19:16:39.799804 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: *** uWSGI is running in multiple interpreter mode *** Jan 26 19:16:39.799804 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: spawned uWSGI master process (pid: 101664) Jan 26 19:16:39.799990 dv-cinder-794001-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 26 19:16:39.805873 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: spawned uWSGI worker 1 (pid: 101665, cores: 1) Jan 26 19:16:39.805873 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: spawned uWSGI worker 2 (pid: 101666, cores: 1) Jan 26 19:16:39.805873 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 26 19:16:41.601337 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:16:41.601337 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: from cryptography.utils import int_from_bytes Jan 26 19:16:41.602010 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:16:41.602010 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: from cryptography.utils import int_from_bytes Jan 26 19:16:41.602328 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:16:41.602328 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: from cryptography.utils import int_from_bytes Jan 26 19:16:41.602792 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:16:41.602792 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: from cryptography.utils import int_from_bytes Jan 26 19:16:44.180713 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 26 19:16:44.181293 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 26 19:16:44.181660 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 26 19:16:44.181765 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 26 19:16:44.181847 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 26 19:16:44.181934 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 26 19:16:44.182019 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 26 19:16:44.182105 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 26 19:16:44.182183 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 26 19:16:44.182259 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 26 19:16:44.182380 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.182597 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.182706 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.182886 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.182981 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183209 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183313 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183527 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183629 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183880 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.183977 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184194 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184299 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184515 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184617 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184829 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.184914 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185144 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185238 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185402 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185492 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185717 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.185810 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-794001-3-iscsi {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186040 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-794001-3-iscsi {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186131 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186350 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186432 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186655 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186747 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.186965 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187048 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187262 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187351 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187574 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187669 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187907 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.187995 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.188219 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.188398 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.188725 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.188821 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189042 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189140 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189351 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189458 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189665 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.189757 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190003 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190112 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190319 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190440 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190636 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190730 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.190941 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191031 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191250 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191358 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191553 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191636 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191895 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.191979 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-794001-3-iscsi {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192269 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192352 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-794001-3-iscsi {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192577 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192669 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192888 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.192988 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.193197 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.193285 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.193611 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.193705 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.193918 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194011 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194233 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194328 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194550 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194638 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194854 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.194942 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195169 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195258 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195483 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195564 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195821 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.195910 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196141 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196225 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196441 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196534 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196745 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.196834 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197050 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197141 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197358 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197439 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197657 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197750 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.197957 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198041 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198202 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198285 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198494 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198587 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198803 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.198885 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199115 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199197 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199435 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199559 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199689 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199814 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.199955 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200038 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200252 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200336 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200566 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200648 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200872 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.200967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201176 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201277 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201481 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201575 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201784 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.201875 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202091 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202172 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202394 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202476 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202698 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.202794 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203005 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203086 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203314 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203397 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203623 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203713 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.203963 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204067 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204268 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204351 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204583 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204687 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204903 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.204986 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205206 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205288 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205513 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205597 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205837 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.205926 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206151 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206233 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206458 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206552 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206773 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.206855 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207089 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207170 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207393 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207482 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207698 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.207811 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208029 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208111 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208338 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208421 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208661 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208743 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.208961 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209056 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209235 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209318 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209540 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209652 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209846 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.209951 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210155 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210258 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210457 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210576 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210762 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.210874 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211066 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211158 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211363 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211491 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211666 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211757 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.211994 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212076 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212298 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212391 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212603 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212686 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212909 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.212991 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213210 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213298 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213513 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213596 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213815 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.213904 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214116 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214199 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214419 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214502 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214737 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.214820 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215041 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215123 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215345 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215429 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215649 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215731 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.215973 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216069 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216279 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216363 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216581 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216669 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216885 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.216975 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217191 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217273 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217491 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217572 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217792 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.217882 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218099 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218188 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218401 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218482 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218704 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.218786 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219010 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219093 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219305 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219387 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219625 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219883 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.219976 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220053 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220244 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220352 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220542 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220639 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220841 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.220969 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221140 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221223 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221439 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221530 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221741 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.221826 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222037 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222118 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222336 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222427 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222632 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222715 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.222929 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223017 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223247 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223337 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223552 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223644 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.223918 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.224012 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.224183 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.224276 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.224485 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.224568 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.225319 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:16:44.225405 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.225645 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.225728 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.225974 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226055 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226284 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226366 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226615 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226700 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.226943 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227026 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227261 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227357 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227571 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227661 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227906 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.227991 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228223 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228316 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228532 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228620 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228843 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.228926 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229152 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229245 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229466 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229549 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229780 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.229861 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230098 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230181 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230419 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230526 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230730 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.230815 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231048 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231144 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231357 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231440 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231665 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.231747 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232010 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232106 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232328 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232416 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232638 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232730 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.232948 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233032 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233289 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233371 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233594 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233677 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233914 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.233999 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234223 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234306 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234538 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234620 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234846 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.234936 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235156 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235247 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235466 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235549 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235802 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.235888 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236122 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236205 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236430 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236522 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236741 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.236830 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237058 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237147 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237370 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237462 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237674 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237764 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.237975 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238064 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238275 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238366 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238576 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238658 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238877 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.238965 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239179 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239273 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239497 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239586 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239822 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.239947 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.240143 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.240227 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241005 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241135 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241318 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241409 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241627 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241718 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.241936 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242024 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242239 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242329 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242544 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242626 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242850 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.242932 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243155 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243240 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243458 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243550 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243779 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.243907 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244097 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244193 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244403 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244513 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244725 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.244808 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245032 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245122 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245337 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245420 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245653 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245737 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.245966 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246057 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246282 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246372 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246594 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246684 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246902 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.246993 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247210 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247293 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247519 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247609 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247878 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.247967 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248210 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248293 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248517 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248601 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248841 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.248924 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249153 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249235 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249457 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249555 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249761 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.249843 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250065 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250147 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250371 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250454 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250672 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250754 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.250994 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251125 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251278 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251371 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251579 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251663 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251906 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.251991 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252209 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252311 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252512 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252596 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252816 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.252897 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253126 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253217 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253429 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253512 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253726 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.253810 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254026 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254116 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254333 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254417 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254652 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254741 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.254967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255056 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255302 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255384 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255615 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255699 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.255983 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256068 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256298 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256381 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256611 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256694 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256916 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.256999 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257225 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257307 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257530 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257612 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257838 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.257923 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258148 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258231 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258455 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258537 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258766 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.258849 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259070 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259152 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259384 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259473 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259688 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.259788 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260025 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260145 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260331 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260432 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260636 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260718 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.260955 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261045 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261282 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261386 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261593 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261684 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.261908 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262024 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262215 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262312 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262522 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262605 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262827 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.262909 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263134 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263225 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263440 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263530 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263746 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.263896 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264081 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264173 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264386 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264469 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264698 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.264787 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265003 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265086 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265318 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265407 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265622 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265712 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.265936 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266042 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266238 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266322 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266544 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266627 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266860 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.266944 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267185 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267275 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267492 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267584 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267840 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.267929 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268141 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268226 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268444 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268535 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268749 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.268839 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269056 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269139 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269359 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269451 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269660 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269743 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.269962 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270065 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270275 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270367 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270578 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270660 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270882 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.270967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.271436 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272066 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272281 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272368 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272586 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272671 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272888 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.272975 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273185 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273268 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273487 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273572 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273801 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.273885 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274106 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274188 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274422 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274507 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274735 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.274827 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275035 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275119 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275333 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275425 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275634 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275723 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.275964 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276049 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276267 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276363 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276565 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276650 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276865 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.276947 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277169 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277260 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277489 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277572 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277788 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.277872 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278094 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278189 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278407 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278496 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278711 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.278795 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279017 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279107 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279320 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279403 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279623 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279707 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.279961 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280047 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280277 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280360 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280583 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280666 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280889 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.280973 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281193 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281277 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281497 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281582 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281812 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.281949 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282108 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282261 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282411 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282554 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282742 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.282826 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283010 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283094 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283307 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283400 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283607 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283689 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.283938 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.284023 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.284252 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.284500 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.284812 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.284895 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285137 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285219 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285456 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285548 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285774 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.285858 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286092 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286176 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286411 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286495 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286735 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.286824 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.287049 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.287139 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.287907 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.287996 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288236 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288341 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288525 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288615 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288825 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.288909 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289129 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289210 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289433 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289519 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289735 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.289827 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290038 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290122 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290346 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290481 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290647 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290730 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.290954 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291036 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291265 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291364 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291568 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291661 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.291906 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292012 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292208 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292293 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292513 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292604 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292809 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.292894 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293119 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293213 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293425 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293519 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293727 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.293811 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294027 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294111 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294327 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294418 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294634 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294725 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.294951 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295034 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295263 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295354 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295591 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295682 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.295940 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296037 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296243 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296334 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296545 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296630 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296863 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.296953 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297164 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297250 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297462 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297546 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297761 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.297845 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298061 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298151 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298362 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298444 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298659 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298743 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.298961 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299050 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299263 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299347 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299568 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299651 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299900 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.299986 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300205 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300288 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300507 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300606 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300806 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.300896 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301113 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301195 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301415 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301505 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301715 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.301805 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302013 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302105 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302313 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302422 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302615 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302705 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.302937 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303025 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303244 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303338 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303544 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303629 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303870 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.303959 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304172 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304274 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304470 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304555 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304769 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.304855 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305069 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305159 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305372 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305462 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305671 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305762 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.305970 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306054 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306282 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306364 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306583 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306674 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306881 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.306966 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307182 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307265 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307480 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307571 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307812 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.307901 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308104 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308187 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308416 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308512 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308726 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.308810 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309023 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309108 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309328 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309421 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309631 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309715 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.309931 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310014 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310232 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310327 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310533 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310652 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310833 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.310924 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311131 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311217 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311429 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311513 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311728 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.311826 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312052 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312145 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312359 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312448 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312663 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312748 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.312965 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313050 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313266 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313350 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313566 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313649 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313870 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.313965 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314196 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314278 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314508 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314599 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314841 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.314980 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315153 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315282 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315468 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315607 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315811 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.315944 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316108 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316235 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316420 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316561 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316718 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.316849 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317026 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317152 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317332 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317471 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317641 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317780 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.317941 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.318072 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.318241 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.318374 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.318575 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.318996 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.319149 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.319383 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.319526 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.319703 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.319857 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320049 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320188 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320369 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320505 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320691 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320817 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.320993 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321119 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321301 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321436 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321610 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321744 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.321916 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322003 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322224 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322359 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322529 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322622 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322839 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.322966 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323146 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323280 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323453 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323580 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323761 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.323941 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324094 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324179 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324397 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324487 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324704 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.324849 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325015 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325135 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325318 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325432 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325637 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325733 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.325946 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326044 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326247 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326331 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326554 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326645 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326856 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.326940 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.327167 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.327250 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.327469 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.327560 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.327911 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328000 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328224 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328309 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328534 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328630 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328840 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.328923 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329147 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329237 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329457 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329549 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329770 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.329852 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330079 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330162 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330381 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330464 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330796 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.330879 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331104 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331189 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331414 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331499 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331726 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.331847 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332051 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332196 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332353 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332438 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332667 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332791 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.332993 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333076 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333301 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333386 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333609 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333691 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.333909 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.334000 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.334744 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.334860 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335125 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335218 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335369 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335486 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335801 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.335891 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336109 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336203 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336414 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336508 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336820 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.336904 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337126 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337212 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337433 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337528 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337751 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.337843 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338069 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338154 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338388 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338473 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338687 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338779 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.338996 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339088 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339302 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339388 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339624 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339707 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.339963 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340061 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340275 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340367 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340588 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340673 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340891 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.340975 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341213 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341298 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341528 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341618 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341839 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.341932 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342157 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342255 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342563 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342678 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342884 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.342979 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343260 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343368 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343506 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343593 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343854 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.343955 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344165 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344263 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344474 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344561 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344786 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.344874 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345109 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345212 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345394 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345486 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345716 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.345810 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346024 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346129 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346336 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346423 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346647 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346744 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.346955 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347041 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347258 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347343 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347555 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347641 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347895 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.347987 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348198 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348301 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348515 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348600 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348825 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.348910 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.349142 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.349228 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.349461 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.349555 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.350315 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.350421 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.350632 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.350731 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.350940 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351035 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351245 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351331 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351543 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351628 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351865 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.351967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352208 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352302 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352512 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352600 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352830 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.352943 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353161 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353254 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353483 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353570 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353791 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.353889 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354122 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354209 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354440 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354526 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354751 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.354847 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355064 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355172 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355386 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355478 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355685 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.355794 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356010 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356102 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356318 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356405 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356622 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.356710 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357274 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357345 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357410 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357489 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357562 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357635 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357808 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.357911 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358086 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358181 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358385 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358471 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358701 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.358793 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359002 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359088 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359322 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359414 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359627 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359720 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.359955 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360045 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360256 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360340 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360555 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360639 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360894 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.360980 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361198 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361284 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361524 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361618 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361840 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.361926 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362157 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362242 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362482 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362576 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362790 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.362883 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363112 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363252 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363424 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363518 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363739 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.363846 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364074 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364172 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364388 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364490 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364702 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.364787 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365015 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365099 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365367 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365507 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365662 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365749 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.365978 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.366061 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.366291 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.366384 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.366605 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.366696 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367131 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367216 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367458 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367543 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367826 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.367917 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368100 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368197 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368411 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368500 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368723 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.368815 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369032 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369125 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369342 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369426 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369647 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369738 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.369957 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370048 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370264 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370348 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370588 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370672 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370904 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.370997 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371226 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371310 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371554 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371638 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371886 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.371977 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372198 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372284 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372509 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372594 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372816 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.372902 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373167 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373257 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373480 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373614 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373784 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.373876 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374092 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374178 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374403 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374497 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374711 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.374805 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375019 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375104 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375328 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375420 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375633 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375819 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.375966 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376052 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376274 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376362 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376579 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376666 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376890 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.376974 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377196 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377289 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377514 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377600 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377845 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.377939 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378159 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378243 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378467 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378552 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378775 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.378869 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.379086 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.379171 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.379590 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.379678 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.379927 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380030 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380253 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380345 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380572 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380658 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.380906 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381006 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381227 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381311 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381538 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381623 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381857 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.381944 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382159 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382251 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382460 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382545 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382816 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.382912 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383073 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383159 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383374 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383498 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383693 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.383831 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384022 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384107 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384325 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384421 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384642 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384728 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.384946 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.385037 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.385472 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.385569 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.385819 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.385948 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386136 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386230 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386457 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386552 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386781 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.386872 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387092 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387189 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387399 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387505 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387717 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.387845 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388048 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388133 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388352 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388468 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388668 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388764 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.388970 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389061 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389273 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389357 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389571 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389654 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389882 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.389968 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390204 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390295 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390491 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390573 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390799 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.390883 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391104 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391195 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391425 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391507 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391728 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.391832 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392062 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392209 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392361 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392491 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392672 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392811 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.392975 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393105 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393277 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393416 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393576 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393715 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.393878 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394007 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394185 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394314 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394486 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394811 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.394962 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395097 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395233 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395378 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395524 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395671 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395761 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395856 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.395979 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.396066 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397051 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397147 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397373 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397509 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397676 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397770 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.397979 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398064 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398290 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398375 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398600 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398685 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.398920 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399008 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399230 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399316 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399540 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399626 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399902 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.399993 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.400218 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.400303 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.400786 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.400889 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401120 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401204 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401435 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401520 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401763 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.401857 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402091 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402176 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402393 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402488 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402697 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402859 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.402997 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403089 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403318 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403405 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403629 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403723 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.403962 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404060 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404272 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404369 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404580 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404675 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404887 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.404981 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405194 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405281 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405503 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405595 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405808 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.405940 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406115 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406207 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406420 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406514 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406728 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.406815 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407038 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407131 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407368 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407454 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407685 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.407799 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408030 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408138 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408340 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408427 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408657 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408742 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.408965 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409058 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409269 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409355 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409572 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409657 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409878 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.409967 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410188 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410285 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410513 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410600 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410825 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.410912 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411124 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411215 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411533 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411621 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411875 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.411968 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.412748 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.412840 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413080 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413179 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413396 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413482 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413712 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.413845 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414032 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414129 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414343 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414429 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414659 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414743 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.414967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415060 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415291 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415381 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415625 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415712 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.415972 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416063 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416294 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416380 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416596 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416680 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416898 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.416984 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417198 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417290 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417505 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417591 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417833 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.417929 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418160 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418247 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418471 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418565 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418789 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.418875 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419099 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419194 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419416 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419509 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419722 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.419832 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420063 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420150 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420381 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420484 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420693 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.420777 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421004 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421088 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421332 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421430 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421640 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421727 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.421951 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422043 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422258 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422351 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422564 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422651 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422872 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.422969 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423175 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423261 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423495 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423582 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423838 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.423986 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424146 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424233 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424463 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424548 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424776 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.424870 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425089 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425175 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425400 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425495 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425707 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.425802 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426029 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426172 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426334 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426429 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426645 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426741 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.426953 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427048 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427262 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427348 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427573 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427659 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.427935 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428025 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428262 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428346 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428586 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428672 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428904 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.428988 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429228 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429323 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429567 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429661 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429879 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.429970 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430216 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430309 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430539 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430626 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430895 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.430987 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.431158 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.431257 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.431459 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.431545 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:16:44.431698 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 26 19:16:44.431812 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 26 19:16:44.454540 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.455613 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.515901 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.context [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),997dbb52-70f5-4978-b985-21ab6ca12bcd(cell1) {{(pid=101665) load_cells /opt/stack/nova/nova/context.py:464}} Jan 26 19:16:44.517395 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.context [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),997dbb52-70f5-4978-b985-21ab6ca12bcd(cell1) {{(pid=101666) load_cells /opt/stack/nova/nova/context.py:464}} Jan 26 19:16:44.520061 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:16:44.522301 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_concurrency.lockutils [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:16:44.522426 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:16:44.523203 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:16:44.523913 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_concurrency.lockutils [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:16:44.524733 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_concurrency.lockutils [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:16:44.525160 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:16:44.526658 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_concurrency.lockutils [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:16:44.535245 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.539454 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.542230 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.544967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.697559 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_db.sqlalchemy.engines [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:44.704310 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG oslo_db.sqlalchemy.engines [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:16:45.032463 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: WARNING keystonemiddleware.auth_token [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:16:45.035012 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: WARNING keystonemiddleware.auth_token [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:16:45.038930 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: WARNING keystonemiddleware.auth_token [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:16:45.041542 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: WARNING keystonemiddleware.auth_token [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:16:45.376041 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: WARNING keystonemiddleware.auth_token [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:16:45.381535 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: WARNING keystonemiddleware.auth_token [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:16:45.381904 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: WARNING keystonemiddleware.auth_token [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:16:45.386743 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: WARNING keystonemiddleware.auth_token [None req-70cf472b-a072-4d35-b1f5-2d5234b77948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:16:45.387043 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557f63e99c0 pid: 101666 (default app) Jan 26 19:16:45.389120 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:16:45.390271 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jan 26 19:16:45.390678 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Wed Jan 26 19:16:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:16:45.392023 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557f63e99c0 pid: 101665 (default app) Jan 26 19:18:09.826656 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:09.827649 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 26 19:18:09.828078 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:10.259985 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-00a99152-1fbc-49ad-83c7-aad8aff17f98 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:10.289625 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-00a99152-1fbc-49ad-83c7-aad8aff17f98 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.454752 Jan 26 19:18:10.300030 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1291 bytes} [Wed Jan 26 19:18:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:18:12.531069 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:12.532115 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-dc6a4afb-8979-4407-9646-4a8f696fc389 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 26 19:18:12.532696 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:12.592962 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-c3e40d1c-1a77-4fd4-a29e-d549da8df837 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:12.610929 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:18:12.610929 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:18:12.639013 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-c3e40d1c-1a77-4fd4-a29e-d549da8df837 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100405 Jan 26 19:18:12.639981 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:18:12.873133 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-d27c367d-51e7-4c48-b54d-e45cf5e8387f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:12.875585 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:18:12.875585 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: warnings.warn(msg) Jan 26 19:18:12.926883 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-d27c367d-51e7-4c48-b54d-e45cf5e8387f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277976 Jan 26 19:18:12.937359 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1335 bytes} [Wed Jan 26 19:18:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:15.219441 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-c3e40d1c-1a77-4fd4-a29e-d549da8df837 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:15.220609 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-c3e40d1c-1a77-4fd4-a29e-d549da8df837 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jan 26 19:18:15.221627 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:15.324025 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-5bd5229c-a53c-444f-9df5-ac3cb2d3a87e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "id": "d1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:15.341963 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:18:15.341963 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: warnings.warn(msg) Jan 26 19:18:15.364556 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-5bd5229c-a53c-444f-9df5-ac3cb2d3a87e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137264 Jan 26 19:18:15.365115 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:15.376579 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-795660a2-41a7-4ff8-af0a-10c71cb490b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:15.378534 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:18:15.378534 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:18:15.411094 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-795660a2-41a7-4ff8-af0a-10c71cb490b7 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037931 Jan 26 19:18:15.411586 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1335 bytes} [Wed Jan 26 19:18:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:17.667600 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-5bd5229c-a53c-444f-9df5-ac3cb2d3a87e admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:17.668669 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-5bd5229c-a53c-444f-9df5-ac3cb2d3a87e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jan 26 19:18:17.669348 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:17.733177 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-7f0ea868-ccad-422b-910b-b773d76afb3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:17.752782 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-7f0ea868-ccad-422b-910b-b773d76afb3f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076885 Jan 26 19:18:17.753560 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:18:17.765072 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-a275d895-fdaa-4768-8805-1f3c401e4c95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:17.789319 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-a275d895-fdaa-4768-8805-1f3c401e4c95 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027666 Jan 26 19:18:17.800279 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1335 bytes} [Wed Jan 26 19:18:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:18:20.061226 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-7f0ea868-ccad-422b-910b-b773d76afb3f admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:20.062247 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-7f0ea868-ccad-422b-910b-b773d76afb3f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jan 26 19:18:20.062660 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:20.128898 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-70abe477-e8ae-4cf3-adc9-31d25555dfff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:20.149774 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-70abe477-e8ae-4cf3-adc9-31d25555dfff admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080495 Jan 26 19:18:20.150329 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:20.162817 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-acb075b9-9839-4a16-9178-13173e788be3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:20.184531 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-acb075b9-9839-4a16-9178-13173e788be3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026065 Jan 26 19:18:20.185120 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1335 bytes} [Wed Jan 26 19:18:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:22.461929 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-70abe477-e8ae-4cf3-adc9-31d25555dfff admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:22.462927 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-70abe477-e8ae-4cf3-adc9-31d25555dfff admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 26 19:18:22.463325 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:22.524086 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:22.542327 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073409 Jan 26 19:18:22.544116 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:18:22.554965 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-35f72c89-fde4-4fa3-a3c3-d6c2f2300797 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:22.579355 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-35f72c89-fde4-4fa3-a3c3-d6c2f2300797 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027843 Jan 26 19:18:22.580099 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1335 bytes} [Wed Jan 26 19:18:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:24.825617 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:24.826623 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 26 19:18:24.827027 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:24.885068 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-fed72149-9051-44d9-912b-262f3041c43c admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:24.909814 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-fed72149-9051-44d9-912b-262f3041c43c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076194 Jan 26 19:18:24.910483 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1291 bytes} [Wed Jan 26 19:18:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:18:27.179405 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:27.180465 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-43810a14-e885-458f-a77b-c022911ea42c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jan 26 19:18:27.180911 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:27.238310 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-a0ce8a72-e02c-4a73-8ae8-15ac1c0c153e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:27.256299 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-a0ce8a72-e02c-4a73-8ae8-15ac1c0c153e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069773 Jan 26 19:18:27.263812 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:27.269912 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-46c6f420-b23a-4a20-ba8e-d3ea37ce4252 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:27.292194 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-46c6f420-b23a-4a20-ba8e-d3ea37ce4252 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026328 Jan 26 19:18:27.292764 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1332 bytes} [Wed Jan 26 19:18:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:29.537353 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-a0ce8a72-e02c-4a73-8ae8-15ac1c0c153e admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:29.538697 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-a0ce8a72-e02c-4a73-8ae8-15ac1c0c153e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 Jan 26 19:18:29.539230 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:29.608492 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-06253af7-c71c-4ed4-a102-5487a5eb1d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:29.627682 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-06253af7-c71c-4ed4-a102-5487a5eb1d6a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082923 Jan 26 19:18:29.628270 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:29.639950 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-cc1b4279-d59a-4060-a148-eb43ca57da8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:29.663385 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-cc1b4279-d59a-4060-a148-eb43ca57da8d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027199 Jan 26 19:18:29.663996 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1332 bytes} [Wed Jan 26 19:18:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:31.909565 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-06253af7-c71c-4ed4-a102-5487a5eb1d6a admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:31.910580 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-06253af7-c71c-4ed4-a102-5487a5eb1d6a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 26 19:18:31.910993 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:31.968301 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-684cfd63-7ead-406d-b63f-6ca2669ad1c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:31.985900 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-684cfd63-7ead-406d-b63f-6ca2669ad1c2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069249 Jan 26 19:18:31.986537 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:31.998126 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-51ba5f2b-1f71-488e-8ea8-59991b4081fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:32.022028 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-51ba5f2b-1f71-488e-8ea8-59991b4081fa admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027539 Jan 26 19:18:32.022602 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1332 bytes} [Wed Jan 26 19:18:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:18:34.267323 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-684cfd63-7ead-406d-b63f-6ca2669ad1c2 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:34.268369 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-684cfd63-7ead-406d-b63f-6ca2669ad1c2 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jan 26 19:18:34.268768 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:34.325897 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-9b47e77d-b19c-4ffc-9166-6f8659e06628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:34.344437 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-9b47e77d-b19c-4ffc-9166-6f8659e06628 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069400 Jan 26 19:18:34.345811 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:18:34.360260 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-36f53b70-3e12-42cd-85c4-dfb91b4bcb0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:34.384705 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-36f53b70-3e12-42cd-85c4-dfb91b4bcb0d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029541 Jan 26 19:18:34.385289 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1332 bytes} [Wed Jan 26 19:18:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:18:36.676914 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-9b47e77d-b19c-4ffc-9166-6f8659e06628 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:36.678475 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-9b47e77d-b19c-4ffc-9166-6f8659e06628 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Jan 26 19:18:36.679093 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:36.740541 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:36.761574 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076721 Jan 26 19:18:36.762133 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1282 bytes} [Wed Jan 26 19:18:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:18:36.774484 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-9c2c4bd8-9558-4e1b-ae83-c2e48ae18c07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:18:36.799086 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-9c2c4bd8-9558-4e1b-ae83-c2e48ae18c07 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028370 Jan 26 19:18:36.799668 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1332 bytes} [Wed Jan 26 19:18:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:18:59.735732 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:59.737378 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jan 26 19:18:59.737801 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:18:59.793227 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-219218b0-7e92-43e2-ac84-a3a36fd68a23 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:18:59.810074 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-219218b0-7e92-43e2-ac84-a3a36fd68a23 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066341 Jan 26 19:18:59.810603 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1291 bytes} [Wed Jan 26 19:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:19:01.202060 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:01.203061 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-31c84be6-8820-4da6-9e3c-d4b010b61780 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 26 19:19:01.203478 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:01.392781 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-a9925809-270d-43d5-a724-51ee0ebbd815 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:01.398423 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.wsgi [None req-a9925809-270d-43d5-a724-51ee0ebbd815 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 26 19:19:01.398990 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-a9925809-270d-43d5-a724-51ee0ebbd815 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:01.399797 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-a9925809-270d-43d5-a724-51ee0ebbd815 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056705 Jan 26 19:19:01.400316 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Jan 26 19:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 26 19:19:01.410993 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-2b4b9628-34b9-4065-9aaa-a79bcae3da93 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:01.436074 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-2b4b9628-34b9-4065-9aaa-a79bcae3da93 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029754 Jan 26 19:19:01.436565 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:01.446313 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-9482c463-d854-46af-82fa-23857230ecb7 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:01.466782 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-9482c463-d854-46af-82fa-23857230ecb7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024040 Jan 26 19:19:01.467328 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:01.477157 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-dc3da391-4186-4d3d-9d90-52cdac78ad7d admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:01.482436 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.wsgi [None req-dc3da391-4186-4d3d-9d90-52cdac78ad7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 26 19:19:01.483000 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-dc3da391-4186-4d3d-9d90-52cdac78ad7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:01.483801 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-dc3da391-4186-4d3d-9d90-52cdac78ad7d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010218 Jan 26 19:19:01.484289 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Jan 26 19:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 26 19:19:02.759204 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-9482c463-d854-46af-82fa-23857230ecb7 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:02.760252 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-9482c463-d854-46af-82fa-23857230ecb7 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 26 19:19:02.760652 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:02.950544 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-33226b2f-5b47-4f46-b347-347ae78d78b6 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:02.956210 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.wsgi [None req-33226b2f-5b47-4f46-b347-347ae78d78b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 26 19:19:02.956775 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-33226b2f-5b47-4f46-b347-347ae78d78b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:02.957592 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-33226b2f-5b47-4f46-b347-347ae78d78b6 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057467 Jan 26 19:19:02.958100 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Jan 26 19:19:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 26 19:19:02.967256 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-79158d83-85be-4ad2-8684-e71219c0633a admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:02.981065 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-79158d83-85be-4ad2-8684-e71219c0633a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017266 Jan 26 19:19:02.981525 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:02.991069 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-4a8fa36b-d0b0-48fd-95ba-e13a02a5cd73 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:03.004065 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-4a8fa36b-d0b0-48fd-95ba-e13a02a5cd73 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016358 Jan 26 19:19:03.004862 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:19:03.013165 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-79abcda2-9691-422f-9f3c-423389270115 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:03.018562 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.wsgi [None req-79abcda2-9691-422f-9f3c-423389270115 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 26 19:19:03.019117 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-79abcda2-9691-422f-9f3c-423389270115 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:03.019934 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-79abcda2-9691-422f-9f3c-423389270115 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010069 Jan 26 19:19:03.020685 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Jan 26 19:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 26 19:19:04.303048 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-4a8fa36b-d0b0-48fd-95ba-e13a02a5cd73 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:04.304066 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-4a8fa36b-d0b0-48fd-95ba-e13a02a5cd73 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 26 19:19:04.304454 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:04.495607 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-ca6bee78-163e-4f3a-ad5d-fdba128dc1fc admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:04.499110 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.wsgi [None req-ca6bee78-163e-4f3a-ad5d-fdba128dc1fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 26 19:19:04.499662 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-ca6bee78-163e-4f3a-ad5d-fdba128dc1fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:04.501126 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-ca6bee78-163e-4f3a-ad5d-fdba128dc1fc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057925 Jan 26 19:19:04.501623 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 26 19:19:04.510983 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-23a70045-88eb-49d8-9e22-cefc45e43543 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:04.524451 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-23a70045-88eb-49d8-9e22-cefc45e43543 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016920 Jan 26 19:19:04.524916 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:19:04.534449 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:04.547641 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017052 Jan 26 19:19:04.548188 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Jan 26 19:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:04.557033 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-d4abf74c-8691-4880-9758-49eb7940fd2a admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:04.562077 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.wsgi [None req-d4abf74c-8691-4880-9758-49eb7940fd2a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 26 19:19:04.563263 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-d4abf74c-8691-4880-9758-49eb7940fd2a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:19:04.564058 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-d4abf74c-8691-4880-9758-49eb7940fd2a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010514 Jan 26 19:19:04.564544 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 26 19:19:05.885128 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:05.886123 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 26 19:19:05.886522 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:06.081978 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-13c0b8d2-4d25-4c18-8a28-3ba0a8795144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:19:06.099223 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-13c0b8d2-4d25-4c18-8a28-3ba0a8795144 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070961 Jan 26 19:19:06.099759 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Jan 26 19:19:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:19:07.364822 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:07.365858 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jan 26 19:19:07.366264 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:07.556847 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-8c6860a7-6aa7-4c10-8d86-c79876819347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:19:07.574563 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-8c6860a7-6aa7-4c10-8d86-c79876819347 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067023 Jan 26 19:19:07.575034 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Jan 26 19:19:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:19:08.849551 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:08.850561 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 26 19:19:08.850968 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:09.044113 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-37631aaa-c6c6-42e2-b99c-0d3e5ef591af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:19:09.062169 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-37631aaa-c6c6-42e2-b99c-0d3e5ef591af admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069215 Jan 26 19:19:09.062630 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Jan 26 19:19:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:19:10.334516 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:10.335508 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jan 26 19:19:10.335961 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:10.525255 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-87a8f1ba-2ef0-4741-8931-c51c2f14df48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:19:10.543395 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-87a8f1ba-2ef0-4741-8931-c51c2f14df48 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068460 Jan 26 19:19:10.543967 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Jan 26 19:19:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:19:11.821951 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:11.822944 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 26 19:19:11.823339 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:12.016145 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-b906e0bb-2ab4-473d-8127-12287361c1a1 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:12.035362 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-b906e0bb-2ab4-473d-8127-12287361c1a1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069983 Jan 26 19:19:12.035891 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Jan 26 19:19:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:57.431857 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.432843 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-d8540ca5-c959-4117-b477-f94aa5668764 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jan 26 19:19:57.433247 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 930 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:19:57.488442 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-21a23582-00c0-45d6-85c1-c5db0836e25f admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.508124 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-21a23582-00c0-45d6-85c1-c5db0836e25f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068650 Jan 26 19:19:57.508650 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1291 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:19:57.530680 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-f8713ce8-3e03-4406-9cd4-a6ff8aaf0c92 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.538138 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-f8713ce8-3e03-4406-9cd4-a6ff8aaf0c92 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010998 Jan 26 19:19:57.538650 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1282 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:19:57.549284 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-3102d5a2-3aac-41b6-a78f-f8cf9798285d admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.556518 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-3102d5a2-3aac-41b6-a78f-f8cf9798285d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010607 Jan 26 19:19:57.557012 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1285 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:19:57.568492 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-214b3572-f771-47ef-9f14-c65337e484b9 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.576342 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-214b3572-f771-47ef-9f14-c65337e484b9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011253 Jan 26 19:19:57.576867 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1285 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:19:57.588551 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:19:57.596035 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010927 Jan 26 19:19:57.596537 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1282 bytes} [Wed Jan 26 19:19:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:21:30.557314 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-416191bc-8ea1-456f-a8a8-9ed7810030e7 tempest-verify_tempest_config-193920615 tempest-verify_tempest_config-193920615-project] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:21:30.559234 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-416191bc-8ea1-456f-a8a8-9ed7810030e7 tempest-verify_tempest_config-193920615 tempest-verify_tempest_config-193920615-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.102853 Jan 26 19:21:30.559818 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 34/69] 10.222.0.50 () {58 vars in 1133 bytes} [Wed Jan 26 19:21:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:23:02.284803 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:02.285791 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jan 26 19:23:02.286180 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 36/70] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:23:02.538831 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:02.540055 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:23:02.540055 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:23:02.541562 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:02.542003 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:02.542795 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:02.543216 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:02.575100 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-f80cca4d-02eb-4743-adb3-445b632b50e1 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145107 Jan 26 19:23:02.575651 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 35/71] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:23:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:23:03.884524 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:03.885526 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jan 26 19:23:03.885915 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 37/72] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:23:04.092270 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:04.093454 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:23:04.093454 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:23:04.094962 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:04.095512 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:04.096337 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:04.096765 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:04.117806 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-ea58144b-ab8a-46bb-b8d8-56dc90096114 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077986 Jan 26 19:23:04.118648 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 36/73] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:23:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:23:15.799080 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:15.800157 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Jan 26 19:23:15.800550 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 38/74] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:23:15.991193 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:15.992404 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:23:15.992404 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:23:15.993906 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:15.994348 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:15.995141 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:15.995568 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:16.019831 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-2c28c11d-b6b9-4e54-ab79-164569d98b5d admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080314 Jan 26 19:23:16.020381 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 37/75] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:23:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:23:17.302098 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: DEBUG nova.api.openstack.wsgi [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] Calling method '>' {{(pid=101666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:17.303075 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: INFO nova.api.openstack.requestlog [None req-83aab4db-a118-416b-9caa-18f9f96d86d0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jan 26 19:23:17.303464 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: [pid: 101666|app: 0|req: 39/76] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Jan 26 19:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:23:17.494254 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG nova.api.openstack.wsgi [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] Calling method '>' {{(pid=101665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:23:17.495421 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:23:17.495421 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: warnings.warn(msg) Jan 26 19:23:17.497053 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:17.497532 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:17.498338 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:23:17.498763 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: DEBUG oslo_concurrency.lockutils [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:23:17.520010 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: INFO nova.api.openstack.requestlog [None req-ac3d993a-6cf5-4a21-ae5b-f2bd857ab46d admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.074960 Jan 26 19:23:17.520492 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: [pid: 101665|app: 0|req: 38/77] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Jan 26 19:23:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:24:15.225579 dv-cinder-794001-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 26 19:24:15.226580 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: Wed Jan 26 19:24:15 2022 - graceful shutdown triggered... Jan 26 19:24:15.227020 dv-cinder-794001-3-iscsi devstack@n-api.service[101666]: Gracefully killing worker 2 (pid: 101666)... Jan 26 19:24:15.227439 dv-cinder-794001-3-iscsi devstack@n-api.service[101665]: Gracefully killing worker 1 (pid: 101665)... Jan 26 19:24:16.226805 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: worker 1 buried after 1 seconds Jan 26 19:24:16.227354 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: worker 2 buried after 1 seconds Jan 26 19:24:16.227354 dv-cinder-794001-3-iscsi devstack@n-api.service[101664]: goodbye to uWSGI. Jan 26 19:24:16.228427 dv-cinder-794001-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 26 19:24:16.229025 dv-cinder-794001-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 26 19:24:16.232405 dv-cinder-794001-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 26 19:24:16.242928 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 26 19:24:16 2022] *** Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: nodename: dv-cinder-794001-3-iscsi Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: machine: x86_64 Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: clock source: unix Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: pcre jit disabled Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: detected number of CPU cores: 4 Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: current working directory: / Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: detected binary path: /usr/bin/uwsgi-core Jan 26 19:24:16.244985 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: your processes number limit is 47680 Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: your memory page size is 4096 bytes Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: detected max file descriptor number: 2048 Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: lock engine: pthread robust mutexes Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: thunder lock: enabled Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 26 19:24:16.245689 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 26 19:24:16.294469 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: Python main interpreter initialized at 0x558f7dd9a9c0 Jan 26 19:24:16.294469 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: python threads support enabled Jan 26 19:24:16.294469 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: your server socket listen backlog is limited to 100 connections Jan 26 19:24:16.294469 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: your mercy for graceful operations on workers is 90 seconds Jan 26 19:24:16.294920 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: mapped 403077 bytes (393 KB) for 2 cores Jan 26 19:24:16.295001 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: *** Operational MODE: preforking *** Jan 26 19:24:16.295246 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: *** uWSGI is running in multiple interpreter mode *** Jan 26 19:24:16.295246 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: spawned uWSGI master process (pid: 116085) Jan 26 19:24:16.295459 dv-cinder-794001-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 26 19:24:16.296074 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: spawned uWSGI worker 1 (pid: 116105, cores: 1) Jan 26 19:24:16.296411 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: spawned uWSGI worker 2 (pid: 116106, cores: 1) Jan 26 19:24:16.297636 dv-cinder-794001-3-iscsi devstack@n-api.service[116085]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 26 19:24:18.257815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:24:18.257815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: from cryptography.utils import int_from_bytes Jan 26 19:24:18.258535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:24:18.258535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: from cryptography.utils import int_from_bytes Jan 26 19:24:18.264822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:24:18.264822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: from cryptography.utils import int_from_bytes Jan 26 19:24:18.265370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 26 19:24:18.265370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: from cryptography.utils import int_from_bytes Jan 26 19:24:23.517344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 26 19:24:23.517951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 26 19:24:23.518225 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 26 19:24:23.518473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 26 19:24:23.518735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 26 19:24:23.519130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.519465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.519805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.520137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.520471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.520789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.521115 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.521443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.521777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.522042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.522361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.522691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-794001-3-iscsi {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.523020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.523599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.523955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.524280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.524591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.524918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.525230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.525737 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.528957 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.529035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.529417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-794001-3-iscsi {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.529939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.530434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.530760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.531187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.531508 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.532026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.532364 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.532698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.533021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.533356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.533688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.534017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.534346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.534662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.534966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.535458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.535805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.536123 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.536435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.536865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.537190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.537523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.537852 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.538187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.538446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.538701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.539028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.539366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.539683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.540030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.540347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.540659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.540979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.541294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.541610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.541928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.542251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.543087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.543416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.543733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.544127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.544534 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.544796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.545113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.545459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.545785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.546101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.546430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.546759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.547075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.547391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.547708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.548067 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.548407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.548724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.548982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.549292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.549611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.549937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.550250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.550565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.550879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.551188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.551502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.551834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.552153 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.552467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.552779 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.553762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.553762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.553762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.554258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.554412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.554714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.554935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.555255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.555563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.555897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.556229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.556543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.556854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.557182 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.557496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.557809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.558670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.558993 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.559308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.559637 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.559970 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.560287 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.560612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.560924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.561237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.561547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.561858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.562170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.562500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.562787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.563098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.563402 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.563726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.564075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.564394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.564749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.565027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.565381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.565676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.566014 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.566361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.566685 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.567026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.567362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.567691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.568053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.568375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.568708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.569029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.569349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.569673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.569999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.570324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.570701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.570978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.571300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.571626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.571968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.572293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.572627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.572952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.573269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.573655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.573895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 26 19:24:23.574390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.574553 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 26 19:24:23.574720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.574952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 26 19:24:23.575120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.575383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 26 19:24:23.575702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.575896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 26 19:24:23.576044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.576194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.576337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.576486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.576638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.576791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.576952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.577106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.577249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.577401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.577558 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.577709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.577852 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.578000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.578150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.578303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.578541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.578697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.578852 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.579015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.579159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.579301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.579451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.579601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-794001-3-iscsi {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.579743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.579920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.580087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.580185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.580269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.580351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.580351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.580508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.580698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.581010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.581520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.581831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.582139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.582450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.582787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.583100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.583413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.583738 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.584551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.584698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.584698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.585001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.585200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.585357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.585599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-794001-3-iscsi {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.585599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.586023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.586165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.586294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.586422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.586422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.587104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.587236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.587375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.587512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.587512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.587765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.587915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.588043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.588187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.588324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.588458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.588601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.588851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.588983 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.589174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.589398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.589534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.589811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.589951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.590124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.590348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.590487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.590744 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.590890 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.591103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.591513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.591713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.592007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.592007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.592499 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.592639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.592639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.593021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.593163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.593163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.593434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.593605 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.593845 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.593981 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.594187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.594462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.594731 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.594865 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.595049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.595306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.595453 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.596195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.596349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.596500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.596631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.596759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.596900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.597030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.597178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.597465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.597621 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.597762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.598104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.598238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.598543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.598676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.598803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.599089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.599231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.599435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.599623 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.599755 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.600086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.600236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.600413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.600628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.600761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.601041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.601311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.601463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.601592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.601728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.601963 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.602104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.602304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.602477 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.602610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.602856 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.603009 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.603251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.603402 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.603539 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.603941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.604084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.604228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.604404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.604543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.604816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.605665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.605807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.605944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.606487 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.606630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.606774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.606903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.607029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.607157 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.607157 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.607490 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.607682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.607682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.607964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.608092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.608218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.608363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.608644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.608776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.608967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.609167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.609306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.609578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.609749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.609887 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.610171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.610304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.610495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.610680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.610813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.611100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.611239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.611501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.611633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.611762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.612072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.612206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.612377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.612639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.612784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.612983 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.613124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.613374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.613569 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.613710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.613904 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.614183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.614329 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.614522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.614712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.614867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.615126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.615266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.615436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.615714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.615898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.616275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.616689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.616824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.616954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.617103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.617234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.617370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.617370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.617629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.617776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.617912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.618040 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.618874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.619042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.619290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.619449 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.619589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 26 19:24:23.619589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.619882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.620013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.620150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.620292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.620292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.621217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.621363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.621515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.621746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.621746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622014 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.622916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.623192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.623331 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.623579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.623729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.623957 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.624316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.624462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.624599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.624789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.624935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.625135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.625282 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.625412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.625722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.625984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.626135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.626500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.626933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.627889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628156 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.628904 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.629074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.629216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.629518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.629649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.629883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630025 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630766 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.630953 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.631108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.631397 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.631529 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.631880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.632999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.633278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.633415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.633614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.633832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.633963 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.634228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.634480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.634620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.634855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.634989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.635170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.635350 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.635489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.635812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.635976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.636228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.636382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.636722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.636866 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.637871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638320 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.638931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.639138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.639271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.639556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.639694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.639913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.640085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.640228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.640524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.640664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.640848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.641164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.641505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.641646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.641841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.642950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.643079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.643367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.643499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.643683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.643928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.644068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.644310 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.644587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.644735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.644915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645492 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.645975 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.646128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.646435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.646586 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.646879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.647950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.648092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.648559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.648699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.648869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.649071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.649210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.649519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.649653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.649851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.650962 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.651101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.651403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.651550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.651720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.651986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.652340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.652488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.652842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.652991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.653289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.653429 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.653729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.653870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.654175 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.654324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.654618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.654794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.654935 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.655219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.655531 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.655662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.655877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.656090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.656223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.656543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.656699 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.656991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.657135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.657272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.657611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.657753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.657898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.658924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.659059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.659289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.659419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.659605 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.659878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660029 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.660942 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.661193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.661324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.661499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.661705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.661851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.662657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.662794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.662932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.663901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.664985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665770 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.665938 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.666079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.666377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.666547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.666766 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.667104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.667260 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668256 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.668923 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669058 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669479 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.669983 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.670268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.670400 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.670591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.670794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.670927 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.671193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.671323 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.671499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.671737 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.671910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.672173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.672311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.672488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.672748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.672898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.673100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.673237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.673423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.673655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.673794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.674977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.675183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.675325 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.675586 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.675719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.675962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.676107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.676273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.676523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.676654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.676871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677780 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.677940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678853 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.678985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.679304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.679511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.679750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.679905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.680187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.680329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.680510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.680688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.680829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.681131 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.681263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.681461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.681630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.681791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.682970 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.683725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.683901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684768 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.684903 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685058 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685058 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685766 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.685973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.686920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687686 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687850 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.687981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.688968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.689111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.689242 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.689518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690517 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.690919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691054 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.691891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.692080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.692260 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.692444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.692682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.692820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693176 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693586 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.693898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.694089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.694221 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.694514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.694666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.694868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.695001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.695128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.695417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.695566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.695705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696513 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.696949 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697094 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.697982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.698150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.698348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.698494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.698836 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.698966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.699095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.699306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.699440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.699665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.699868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.700926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.701203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.701336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.701537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.701743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.701885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.702146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.702276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.702452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.702654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.702787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.703066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.703214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.703375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.703595 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.703735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704537 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.704941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.705089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.705229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.705542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.705683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.705840 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706051 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.706965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.707105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.707351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.707505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.707821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.707956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.708085 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.708273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.708444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.708581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.708894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.709959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.710146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.710278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.710482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.710675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.710807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.711061 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.711199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.711374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.711680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.711873 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712141 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712320 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712532 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712674 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.712922 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713598 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713836 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.713967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.714147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.714409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.714543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.714804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.714948 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.715141 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.715343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.715484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.715708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.715965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.716099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.716343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.716482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.716653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.716884 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.717031 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.717262 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.717407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.717612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.717884 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.718860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.719482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.719626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.719758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.719924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720055 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.720896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.721201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.721339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.721516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.721691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.721824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.722133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.722341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.722540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.722671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.722852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.723054 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.723194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.723454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.723588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.723798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.724034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.724177 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.724408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.724554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.724714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.725476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.725627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.725838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.725969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.725969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726231 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.726916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.727052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.727240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.727417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.727559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.727939 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728204 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.728921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.729261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.729414 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.729544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.729717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.729848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.730632 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.730765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.731050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.731190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.731364 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.731572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.731718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.732958 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.733159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.733291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.733575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.733713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.733899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.734190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.734331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.734525 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.734686 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.734847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.735144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.735277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.735489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.735700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.735959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.736092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.736234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.736414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.736730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.736869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.737125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.737271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.737444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.737635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.737789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738259 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738577 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.738970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.739111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.739277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.739517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.739753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.739921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.740944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.741125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.741395 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.741536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.741739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.741891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.742024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.742322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.742462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.742646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.742944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.743077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.743271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.743451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.743605 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.743912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.744057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.744238 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.744416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.744631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.746383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.746529 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.746662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.746805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.746944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.747953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748707 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748853 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.748994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.749980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750772 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.750902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.751982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.752143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.752374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.752521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.752759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.752888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.753066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.753329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.753468 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.753687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.753839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754567 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.754905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.755194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.755332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.755528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.755683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.755889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.756149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.756291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.756810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.756946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.757855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.758101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.758441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.758584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.758721 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.758864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.759102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.759697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.760928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.761186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.761480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.761617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.761757 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.761949 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.762122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.762255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.762572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.762704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.762890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.763065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.763198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764254 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.764960 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.765089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.765217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.765358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.765507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766350 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.766929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767667 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.767877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.768095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.768266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.768640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.768788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.768788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.769896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.770212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.770649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.770812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.770941 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771054 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771166 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.771859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.772074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.772217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.772625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.772762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.772952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.773552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.773739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.773871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.774189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.774340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.774744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.774883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.775145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.775433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.775576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.775846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.776046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.776262 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.776538 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.776916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.777066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.777259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.777393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.777575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.777789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.778013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.778208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.778353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.778501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.778906 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779307 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779704 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.779909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.780076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.780360 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.780862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.781041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.781219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.781394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.781527 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.781849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.782032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.782163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.782482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.782697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.782830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.783109 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.783275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.783406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.783670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.783877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.784947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.785146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.785318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.785559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.785700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.785866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.786107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.786244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.786456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.786630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.786785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.787098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.787856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.788556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789184 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789184 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.789871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.790125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.790290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.790433 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.790649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.790890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791323 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.791893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.792043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.792204 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.792990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.793137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.793333 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.793466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.793647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.793904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794047 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.794974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.795233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.795393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.795705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.795880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.796160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.796297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.796482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.796676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.796817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.797134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.797285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.797424 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.797726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.797870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.798027 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.798238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.798409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.798641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.798779 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.799905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.800161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.800304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.800486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.800720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.800880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.801988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.802308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.802477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.802633 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.802808 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.802941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.803261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.803409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.803575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.803808 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.803946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.804201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.804349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.804514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.804741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.804879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.805127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.805299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.805448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.805712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.805846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.806055 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.806212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.806485 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.806633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.806801 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.807231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.807381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.807520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.807659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.807843 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.808132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.808767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.808959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.809283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.809431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.809569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.809706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.809962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.810117 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.810255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.810526 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.810671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.810913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.811065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.811302 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.811476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.811752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.812515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.812515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.812774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.812912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.813883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.814887 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.815064 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.815197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.815507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.815639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.815838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.816966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.817099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.817409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.817548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.817714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.817978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.818127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.818349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.818495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.818663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.818916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.819126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.819500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.819750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.819944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.820910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.821146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.821303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.821545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.821678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.821815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.822995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.823134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.823324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.823466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.823676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.823955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.824135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.824368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.824510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.824682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.824868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.825972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.826254 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.826387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.826515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 26 19:24:23.826750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.827134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.827610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.828016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.828432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.828827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.829251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.829648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.830042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.830446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.830837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.831229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.831664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.832085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.832753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.833167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.833571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.833999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.834408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.834795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.835181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.835566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.835998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.836394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.836977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.837175 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.837597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.837979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.838394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.838780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.839165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.839697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.840114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.840509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.840906 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.841349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.842088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.842088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.842473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.842867 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.843299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.843648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.844068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.845608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.845608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.845608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.845608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.846394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.846592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.846861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.847250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.847717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.848073 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.848460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.848888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.849275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.849793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:23.850022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.850022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.850489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.850927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.851647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.852424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.852424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.852855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.853036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.853502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.853781 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.854130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.854518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.855376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.855735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.856101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.856426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.856787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.857123 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.857448 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.857883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.858114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.858438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.858868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.859081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.859409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.859917 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.860060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.860406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.860745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.861062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.861399 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.861784 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.862052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.862383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.862768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.863044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.863365 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.863692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.864065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.864363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.864691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.865020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.865355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.865689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.866608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.866608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.866883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.867021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.867351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.867689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.868092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.868466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.868792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 26 19:24:23.869044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 26 19:24:23.892654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_db.sqlalchemy.engines [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:23.916843 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.context [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),997dbb52-70f5-4978-b985-21ab6ca12bcd(cell1) {{(pid=116105) load_cells /opt/stack/nova/nova/context.py:464}} Jan 26 19:24:23.921809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:23.923544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:23.924457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:23.926449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:23.938156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:23.938669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:23.956251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.context [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),997dbb52-70f5-4978-b985-21ab6ca12bcd(cell1) {{(pid=116106) load_cells /opt/stack/nova/nova/context.py:464}} Jan 26 19:24:23.960565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:23.962165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:23.962998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:23.965524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:23.976232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_db.sqlalchemy.engines [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:23.978055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_db.sqlalchemy.engines [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:24.095183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:24.142820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_db.sqlalchemy.engines [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 26 19:24:24.428147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:24:24.434869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:24:24.476687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: WARNING keystonemiddleware.auth_token [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:24:24.483957 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: WARNING keystonemiddleware.auth_token [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:24:24.782399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:24:24.787908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-76a625c5-ec6c-481f-8ab3-7aadcf23cc6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:24:24.793131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x558f7dd9a9c0 pid: 116105 (default app) Jan 26 19:24:24.832006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: WARNING keystonemiddleware.auth_token [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 26 19:24:24.837387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: WARNING keystonemiddleware.auth_token [None req-76757383-c3f7-49ef-8790-bdf71e6bf70d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 26 19:24:24.843403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x558f7dd9a9c0 pid: 116106 (default app) Jan 26 19:24:56.717106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-160435464", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "26b2db68-da0a-45e2-a594-43d4959688a1"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:24:57.065951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-61d7e70d-1cbf-4e02-ac53-65ade205e79e tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Action: 'create', calling method: .version_select at 0x7fb7c2d96af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-326806915", "metadata": {"Type": "work"}}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:24:57.067840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-61d7e70d-1cbf-4e02-ac53-65ade205e79e tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:57.068761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-61d7e70d-1cbf-4e02-ac53-65ade205e79e tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.222300 Jan 26 19:24:57.069390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Jan 26 19:24:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 26 19:24:57.081385 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6ba32a6b-1a66-4347-94b3-c2ce9149b9dd tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Action: 'create', calling method: .version_select at 0x7fb7c2dad670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1339284976", "metadata": {"Type": "work"}}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:24:57.083040 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6ba32a6b-1a66-4347-94b3-c2ce9149b9dd tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:57.083904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6ba32a6b-1a66-4347-94b3-c2ce9149b9dd tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006495 Jan 26 19:24:57.084806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 2/2] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Jan 26 19:24:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:24:57.096885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3b8dcd0a-c3b5-476e-b82a-4303c0683831 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Action: 'create', calling method: .version_select at 0x7fb7c2d96b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-418820686", "metadata": {"Type": "work"}}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:24:57.098289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3b8dcd0a-c3b5-476e-b82a-4303c0683831 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:57.099286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3b8dcd0a-c3b5-476e-b82a-4303c0683831 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006293 Jan 26 19:24:57.106143 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 3/3] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Jan 26 19:24:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:24:57.110670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-04ba823d-579f-41ef-8e3e-17e155cd259d tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Calling method '.version_select at 0x7fb7c2c77160>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:24:57.515437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] validate_networks() for [('26b2db68-da0a-45e2-a594-43d4959688a1', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:24:57.953662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-04ba823d-579f-41ef-8e3e-17e155cd259d tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] HTTP exception thrown: Volume tempest-invalid-1192085280 could not be found. Jan 26 19:24:57.954407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-04ba823d-579f-41ef-8e3e-17e155cd259d tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 404 to user: Volume tempest-invalid-1192085280 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:57.955312 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-04ba823d-579f-41ef-8e3e-17e155cd259d tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1192085280" status: 404 len: 99 microversion: 2.1 time: 0.848042 Jan 26 19:24:57.961745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 4/4] 10.222.0.50 () {58 vars in 1217 bytes} [Wed Jan 26 19:24:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1192085280 => generated 99 bytes in 855 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 26 19:24:57.967746 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-859f703f-c2df-41c3-a264-c3787a1d3d43 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004726 Jan 26 19:24:57.968361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 5/5] 10.222.0.50 () {58 vars in 1139 bytes} [Wed Jan 26 19:24:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 26 19:24:57.992916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-20606d19-11ec-436c-b154-920dcdce545e tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010914 Jan 26 19:24:57.993491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 6/6] 10.222.0.50 () {58 vars in 1136 bytes} [Wed Jan 26 19:24:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 26 19:24:58.004471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-09ab175f-bee7-4ba4-8247-04d8a64e6daf tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Calling method '.version_select at 0x7fb7c3580040>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:24:58.081777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-09ab175f-bee7-4ba4-8247-04d8a64e6daf tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] HTTP exception thrown: Volume bab9a172-22d9-4932-a1ab-b69576196568 could not be found. Jan 26 19:24:58.082555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-09ab175f-bee7-4ba4-8247-04d8a64e6daf tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 404 to user: Volume bab9a172-22d9-4932-a1ab-b69576196568 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:58.084396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-09ab175f-bee7-4ba4-8247-04d8a64e6daf tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/bab9a172-22d9-4932-a1ab-b69576196568" status: 404 len: 109 microversion: 2.1 time: 0.083563 Jan 26 19:24:58.085169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 7/7] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:24:57 2022] DELETE /compute/v2.1/os-volumes/bab9a172-22d9-4932-a1ab-b69576196568 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:24:58.095860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cc5a0591-f141-43ee-9c9c-f70e289ef132 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Calling method '.version_select at 0x7fb7c2bff310>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:24:58.288119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-cc5a0591-f141-43ee-9c9c-f70e289ef132 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] HTTP exception thrown: Volume 517f47e1-001e-42c5-ab10-75ec8fc58f4d could not be found. Jan 26 19:24:58.288972 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cc5a0591-f141-43ee-9c9c-f70e289ef132 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] Returning 404 to user: Volume 517f47e1-001e-42c5-ab10-75ec8fc58f4d could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:24:58.290167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cc5a0591-f141-43ee-9c9c-f70e289ef132 tempest-VolumesNegativeTest-1085854251 tempest-VolumesNegativeTest-1085854251-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/517f47e1-001e-42c5-ab10-75ec8fc58f4d" status: 404 len: 109 microversion: 2.1 time: 0.198986 Jan 26 19:24:58.290905 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 8/8] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:24:58 2022] GET /compute/v2.1/os-volumes/517f47e1-001e-42c5-ab10-75ec8fc58f4d => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 26 19:24:59.508539 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:24:59.509087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:24:59.510482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:24:59.512073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:24:59.512770 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:24:59.545177 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:59.546482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:59.548951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:24:59.550408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:24:59.602838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Getting quotas for project 628a0f3ad3b346df9f72a9114ea1e869. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:24:59.636620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Getting quotas for user aa80a5e4ba714232930345e35af0f527 and project 628a0f3ad3b346df9f72a9114ea1e869. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:24:59.636872 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dcfbbce1-ccee-4e30-822e-d8d5205c1aeb tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c2c729d0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:24:59.656288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:24:59.662421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:24:59.817045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-38401b85-959b-46d7-b061-2bd4045c7fc9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.447967 Jan 26 19:24:59.817683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 1/9] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:24:59.820625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dcfbbce1-ccee-4e30-822e-d8d5205c1aeb tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/9734b75b-1b4d-4468-a06a-77c11e537e84" status: 200 len: 351 microversion: 2.1 time: 0.189024 Jan 26 19:24:59.821218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 9/10] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:24:59 2022] GET /compute/v2.1/os-volumes/9734b75b-1b4d-4468-a06a-77c11e537e84 => generated 351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:24:59.832340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5434c1c-00a2-4d05-a606-09b1030d0413 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:24:59.832954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d5434c1c-00a2-4d05-a606-09b1030d0413 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:00.035468 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5434c1c-00a2-4d05-a606-09b1030d0413 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:00.051996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5434c1c-00a2-4d05-a606-09b1030d0413 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1214 microversion: 2.1 time: 0.225831 Jan 26 19:25:00.059000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 2/11] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:24:59 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:01.079648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c50c1cc8-94e7-44fa-ab9d-99dde52af3c8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:01.081180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c50c1cc8-94e7-44fa-ab9d-99dde52af3c8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:01.731113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c50c1cc8-94e7-44fa-ab9d-99dde52af3c8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:01.777496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c50c1cc8-94e7-44fa-ab9d-99dde52af3c8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1214 microversion: 2.1 time: 0.702951 Jan 26 19:25:01.780054 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 10/12] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:01 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1214 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:02.179401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5cc3243e-9b47-41a2-b4c5-99b24459b553 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c23afee0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:02.390255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5cc3243e-9b47-41a2-b4c5-99b24459b553 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/3fc71db3-8878-40c8-b7be-4e574411cbfa" status: 200 len: 350 microversion: 2.1 time: 0.217260 Jan 26 19:25:02.390982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 3/13] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:25:02 2022] GET /compute/v2.1/os-volumes/3fc71db3-8878-40c8-b7be-4e574411cbfa => generated 350 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:02.797811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:02.798431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:02.807250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:02.807714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:02.809904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:02.810370 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:03.157636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:03.202310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4f183ee8-f32d-4620-841a-afb3c277724f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1210 microversion: 2.1 time: 0.408858 Jan 26 19:25:03.203890 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 11/14] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:02 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1210 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:04.220837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:04.222276 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:04.241890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:04.243194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:04.244813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:04.248893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:04.614254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:04.627509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9808ec92-7bb3-4be6-9e5c-89377fc3f2fe tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1266 microversion: 2.1 time: 0.411021 Jan 26 19:25:04.628925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 4/15] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:04 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:05.644903 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:05.646711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:05.659136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:05.660018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:05.661221 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:05.661681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:05.911973 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:05.928594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-38a06823-79ac-4d93-942b-0af3f40ac74c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1266 microversion: 2.1 time: 0.287363 Jan 26 19:25:05.930714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 12/16] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:05 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:06.948565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:06.951536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:06.959378 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:06.965956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:06.967284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:06.975168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:07.201728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:07.215187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-203b92f5-2ca3-4ca8-a1cc-a38ed85d5a3e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1266 microversion: 2.1 time: 0.269929 Jan 26 19:25:07.219233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 5/17] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:06 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:08.219524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: .version_select at 0x7fb7c2dad040>, body: {"keypair": {"name": "tempest-keypair-951679282"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:08.246265 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:08.247078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:08.260616 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:08.263949 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:08.266295 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:08.267010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:08.405153 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:08.424113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:08.601996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:08.630812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e927f52e-ddc3-477f-bc67-591b1e3a0007 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1274 microversion: 2.1 time: 0.399981 Jan 26 19:25:08.635151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 6/18] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:08 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:09.402876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:09.411873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:09.442267 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7e1e0ef4-7f86-420b-b3a1-7af111272d6d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.556601 Jan 26 19:25:09.446522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 13/19] 10.222.0.50 () {60 vars in 1157 bytes} [Wed Jan 26 19:25:07 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:09.650630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:09.651241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:09.666741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:09.667275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:09.668249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:09.668637 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:09.735581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: .version_select at 0x7fb7c2dae4c0>, body: {"keypair": {"name": "tempest-keypair-448525966"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:09.803291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:09.818889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:09.852435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:09.865954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-47ff9e04-1983-4256-a584-686f18f8713e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1272 microversion: 2.1 time: 0.219384 Jan 26 19:25:09.871075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 14/20] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:09 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:10.054729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:10.059702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:10.081800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4aecfd45-b02e-4a72-8e21-24c2293b84b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.808527 Jan 26 19:25:10.086019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 7/21] 10.222.0.50 () {62 vars in 1198 bytes} [Wed Jan 26 19:25:09 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 812 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 26 19:25:10.230868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f4cceffe-32f7-46c4-b4f1-7edd9afd6a1e tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c2af4790>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:10.360551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f4cceffe-32f7-46c4-b4f1-7edd9afd6a1e tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/3173e0c9-6ced-49cb-acfd-788215099208" status: 200 len: 351 microversion: 2.1 time: 0.134536 Jan 26 19:25:10.361372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 15/22] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:25:10 2022] GET /compute/v2.1/os-volumes/3173e0c9-6ced-49cb-acfd-788215099208 => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:10.374482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3b3be26-6a37-4825-a644-07447be482a1 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c1a05040>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:10.694033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3b3be26-6a37-4825-a644-07447be482a1 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.324938 Jan 26 19:25:10.702108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 8/23] 10.222.0.50 () {58 vars in 1133 bytes} [Wed Jan 26 19:25:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:10.717940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bdbc9c70-c088-458c-9732-61607416c656 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c22ab280>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:10.902188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:10.902933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:10.939762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:10.952007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:10.953784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:10.959069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:10.970138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bdbc9c70-c088-458c-9732-61607416c656 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.266497 Jan 26 19:25:10.978131 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 16/24] 10.222.0.50 () {58 vars in 1148 bytes} [Wed Jan 26 19:25:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:10.983510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-88670ce0-7613-4d1a-8857-c385ce90dd9b tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c229c4c0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:11.262046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-88670ce0-7613-4d1a-8857-c385ce90dd9b tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.281377 Jan 26 19:25:11.271914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 17/25] 10.222.0.50 () {58 vars in 1133 bytes} [Wed Jan 26 19:25:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:11.284803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-45054692-9c78-4f2f-bfb6-f10a23ab9aeb tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c229ce50>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:11.308543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:11.348555 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c3acbfe-1812-40b8-8190-c263455b7bbd tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1272 microversion: 2.1 time: 0.465412 Jan 26 19:25:11.352127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 9/26] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:10 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:11.645627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-45054692-9c78-4f2f-bfb6-f10a23ab9aeb tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.366791 Jan 26 19:25:11.653608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 18/27] 10.222.0.50 () {58 vars in 1166 bytes} [Wed Jan 26 19:25:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:11.658595 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-85665f7e-9371-472f-8980-693045840e90 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c1a97b80>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:11.834387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-85665f7e-9371-472f-8980-693045840e90 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.179689 Jan 26 19:25:11.845308 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 10/28] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Jan 26 19:25:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:11.851927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9f4e122c-a235-4093-b781-6f081d315746 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c22abf70>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:12.123206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9f4e122c-a235-4093-b781-6f081d315746 tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.275649 Jan 26 19:25:12.137993 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ec7bc0d6-a826-4204-8fd6-8dc865cf2fff tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c1a11670>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:12.139858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 19/29] 10.222.0.50 () {58 vars in 1154 bytes} [Wed Jan 26 19:25:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:12.371272 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:12.372119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:12.391700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:12.406100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:12.407020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:12.407477 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:12.418317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ec7bc0d6-a826-4204-8fd6-8dc865cf2fff tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.285997 Jan 26 19:25:12.419653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 11/30] 10.222.0.50 () {58 vars in 1187 bytes} [Wed Jan 26 19:25:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:12.433650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-764ea9f1-4f20-4774-bd61-e3fef002a54d tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] Calling method '.version_select at 0x7fb7c19c0ca0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:12.750043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-764ea9f1-4f20-4774-bd61-e3fef002a54d tempest-VolumesTestJSON-275114809 tempest-VolumesTestJSON-275114809-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.321404 Jan 26 19:25:12.751047 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 12/31] 10.222.0.50 () {58 vars in 1154 bytes} [Wed Jan 26 19:25:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:13.093159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870941595", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:13.263384 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] validate_networks() for [('8746d71a-820a-4b05-87b9-92fff64ad22d', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:25:13.562850 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:13.570730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5a567a34-6433-44b6-8171-44eaad0a9470 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 1.204050 Jan 26 19:25:13.571306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 20/32] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:12 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:13.889624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:25:13.890264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:25:13.890779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:25:13.894317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:25:13.895146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:25:13.919050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:13.921678 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:13.933695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:13.934380 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:13.977106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Getting quotas for project 93424b38a7474b9787347d46184008c3. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:13.986687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Getting quotas for user 6484f0bf99384bf2b80c3cffb9f9ae66 and project 93424b38a7474b9787347d46184008c3. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:14.017092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:25:14.019954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:25:14.095844 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-003ee7b7-9a98-45c2-a0cf-95adcee4d01d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.286186 Jan 26 19:25:14.097078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 13/33] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:25:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:25:14.107120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5eeef039-12b8-45c0-b572-f40e4ce8f106 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:14.107750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5eeef039-12b8-45c0-b572-f40e4ce8f106 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:14.507935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5eeef039-12b8-45c0-b572-f40e4ce8f106 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:14.520450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5eeef039-12b8-45c0-b572-f40e4ce8f106 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1222 microversion: 2.1 time: 0.417246 Jan 26 19:25:14.521561 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 21/34] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:14 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1222 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:14.591274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:14.591953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:14.614155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:14.614607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:14.615427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:14.630071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:14.851146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-804314074", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:15.012343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] validate_networks() for [('8746d71a-820a-4b05-87b9-92fff64ad22d', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:25:15.168679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:15.178350 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9bb44c49-1a5a-4ad8-a246-d9352df615f8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.593779 Jan 26 19:25:15.197764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 14/35] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:14 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:16.195028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:16.196551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:16.214374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:16.216292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:16.219072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:16.219535 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:16.725251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:16.745846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9419d9b3-0503-4323-a69f-52cf9c1cad27 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.546289 Jan 26 19:25:16.757851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 15/36] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:16 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:17.304672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-402052605", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a6e7ac6-67af-4ed8-a922-1c3a4f2dca5c"}], "security_groups": [{"name": "tempest-securitygroup--640489915"}], "key_name": "tempest-keypair-951679282", "user_data": "}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:17.550916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] validate_networks() for [('1a6e7ac6-67af-4ed8-a922-1c3a4f2dca5c', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:25:17.970090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:25:17.971795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:25:17.972324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:25:17.976982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:25:17.977389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:25:18.010110 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:18.011306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:18.013356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:18.016753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:18.083378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Getting quotas for project 93424b38a7474b9787347d46184008c3. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:18.102078 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Getting quotas for user 6484f0bf99384bf2b80c3cffb9f9ae66 and project 93424b38a7474b9787347d46184008c3. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:18.122361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:25:18.125985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:25:18.329832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-09dddf07-bdb6-4f2f-a786-11990b59933b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.480622 Jan 26 19:25:18.334604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 22/37] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:25:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:25:18.367114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1049640289", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68fda3bd-90ff-4f20-8f16-b16096f575dd"}], "security_groups": [{"name": "tempest-securitygroup--1438542806"}], "key_name": "tempest-keypair-448525966", "user_data": "}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:18.644899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] validate_networks() for [('68fda3bd-90ff-4f20-8f16-b16096f575dd', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:25:19.345731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:25:19.346220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:25:19.346689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:25:19.347149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:25:19.347611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:25:19.390097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:19.390645 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:19.399345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:19.404780 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:19.511499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:19.552489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:19.642976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:25:19.659504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:25:19.874135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-156fb4bb-a9bb-48ea-a6c0-e6b0ed591a91 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.576968 Jan 26 19:25:19.880856 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 16/38] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:25:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:25:19.886647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:19.895362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:19.930627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:19.940563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:19.943220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:19.943933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:20.854805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:25:20.855332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:25:20.855856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:25:20.856446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:25:20.856869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:25:20.890378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:20.890836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:20.891659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:20.892135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:20.982278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:25:21.003284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:25:21.062769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:25:21.073639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:25:21.258979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ad0d2680-fc92-4e2a-9a18-3fed1c60a54d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.911191 Jan 26 19:25:21.268950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 23/39] 10.222.0.50 () {62 vars in 1187 bytes} [Wed Jan 26 19:25:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 26 19:25:21.280307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.288669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:21.292079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c4c1cbae-1993-47de-bb69-389ee428fb1d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 1.409640 Jan 26 19:25:21.294874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 17/40] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:19 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:21.294989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:21.305274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:21.310817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:21.335171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:21.335622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:21.336445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:21.340569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:21.345081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:21.352324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:21.353919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:21.359415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:21.597438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.614056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2a20cdbb-ce0b-432c-9cf0-a2a998773c97 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1273 microversion: 2.1 time: 0.342321 Jan 26 19:25:21.626262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 24/41] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:21 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:21.641455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:21.663937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:21.878560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.887699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.891522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.896324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3076d651-febd-45bf-b67f-eaf5c1ef8c1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1281 microversion: 2.20 time: 0.269446 Jan 26 19:25:21.897535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 25/42] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:21 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1281 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:21.981680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:21.994764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4845495c-53ca-4d89-82ca-2f8ec28dc757 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1240 microversion: 2.1 time: 0.698461 Jan 26 19:25:21.999599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 18/43] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:21 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1240 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:22.316445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:22.318129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:22.373126 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:22.375977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:22.383452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:22.386798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:22.635728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:22.636386 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:22.663730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:22.669930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:22.669930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:22.669930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:22.965288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:22.992616 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-816d70fa-918d-4e71-86f4-2d6039d205ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1279 microversion: 2.1 time: 0.350783 Jan 26 19:25:22.993301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 19/44] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:22 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1279 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:23.023669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:23.026002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:23.050871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:23.056281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:23.058518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:23.060863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:23.486496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:23.498190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f4ee3760-2b65-4a8a-b372-923ffe5a176c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 1.190537 Jan 26 19:25:23.498763 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 26/45] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:22 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:23.526038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:23.526709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:23.584548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:23.585411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:23.587509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:23.591292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:23.816789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:23.839022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0fe6b2f6-4f42-4f7e-bb34-8a103e31a54e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1294 microversion: 2.1 time: 0.322012 Jan 26 19:25:23.841195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 27/46] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:23 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1294 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:23.896558 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:23.935245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:23.947720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:23.950574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-946dd066-a5dd-48e9-8452-77c8fa1f4869 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1333 microversion: 2.20 time: 0.945154 Jan 26 19:25:23.961746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 20/47] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:22 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1333 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:24.011418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:24.012079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:24.019222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.032984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:24.037398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.044502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:24.430496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:24.460245 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-040bbaf6-7874-4ca2-bb92-f4622073b535 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1279 microversion: 2.1 time: 0.453299 Jan 26 19:25:24.461020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 28/48] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:24 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1279 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:24.517591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:24.518472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:24.549654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.552029 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:24.558596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.561640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:24.859150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:24.860007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:24.872759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.873268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:24.881258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:24.881900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.063040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:26.077823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f062e2e0-c13f-4433-a942-18d75deee987 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 1.563339 Jan 26 19:25:26.078793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 21/49] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:24 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:26.094705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:26.095603 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:26.113415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.114828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.117624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.120588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.340580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:26.354989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ca278100-0bfc-449d-b564-7ce21968d6fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 1.499759 Jan 26 19:25:26.355588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 29/50] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:24 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:26.369332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:26.370161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:26.385918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.386652 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.390722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.391310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.614398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:26.635959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:26.639469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:26.640706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-192eb9ec-19d7-41f1-85e3-4a50cc3b83bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1339 microversion: 2.20 time: 0.558205 Jan 26 19:25:26.641283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 22/51] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:26 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1339 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:26.838390 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-93e07586-46d9-4993-8a18-a146d251a7dd req-7e3573a9-b662-4647-9962-bc26a5963b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83ec467-f057-4a9b-91c7-302bc3507bf2", "tag": "1a5716f6-ee7f-47b4-9680-f7b8772235cd"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:26.840798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:26.840798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:25:26.853417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-93e07586-46d9-4993-8a18-a146d251a7dd req-7e3573a9-b662-4647-9962-bc26a5963b3b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.854228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-93e07586-46d9-4993-8a18-a146d251a7dd req-7e3573a9-b662-4647-9962-bc26a5963b3b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.880739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-93e07586-46d9-4993-8a18-a146d251a7dd req-7e3573a9-b662-4647-9962-bc26a5963b3b service nova] Creating event network-changed:1a5716f6-ee7f-47b4-9680-f7b8772235cd for instance c83ec467-f057-4a9b-91c7-302bc3507bf2 on hv-cinder-79400 Jan 26 19:25:26.881275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-93e07586-46d9-4993-8a18-a146d251a7dd req-7e3573a9-b662-4647-9962-bc26a5963b3b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 26 19:25:26.882400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.882973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.883818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:26.884938 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:26.895950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.compute.rpcapi [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 26 19:25:26.897045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 26 19:25:26.916067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cf29c007-ba5d-4109-b53e-a8f266787fb3 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176926 Jan 26 19:25:26.916982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 23/52] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:27.096365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:27.098601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:27.107028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.107851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.109121 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.109687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.392184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.402761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-85f8833a-50d6-4e7f-8536-e991e273b47e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 1.042747 Jan 26 19:25:27.407414 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 30/53] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:26 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:27.426274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:27.428135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:27.442435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.442876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.443698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.444207 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.516108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.534736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc388f15-3cc3-44b9-a9ca-fd6b0f151749 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.442132 Jan 26 19:25:27.545888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 24/54] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:27 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:27.658736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:27.659348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:27.671575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.672073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.672867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:27.673304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:27.839718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.849444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.856594 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.857798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65274bcd-7488-4862-9178-40fa66fca57e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1339 microversion: 2.20 time: 0.203229 Jan 26 19:25:27.858391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 25/55] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:27 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:27.988153 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:27.995717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-40858774-c32f-4973-8faf-2c34e394374c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.586875 Jan 26 19:25:27.996323 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 31/56] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:27 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:28.426944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:28.427580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:28.438583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.445769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.451383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.455365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.795426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-8f9d848a-7e42-4bab-ad09-a95de0fc1b63 req-72a854c9-3f49-48db-91ee-acae4b94028a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2538c057-6851-449d-a4a4-bdce032a9be8", "tag": "6758173a-c05b-4dbe-a01f-d4b556f91c47"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:28.797679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:28.797679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:25:28.811860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-8f9d848a-7e42-4bab-ad09-a95de0fc1b63 req-72a854c9-3f49-48db-91ee-acae4b94028a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.812738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-8f9d848a-7e42-4bab-ad09-a95de0fc1b63 req-72a854c9-3f49-48db-91ee-acae4b94028a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.858382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-8f9d848a-7e42-4bab-ad09-a95de0fc1b63 req-72a854c9-3f49-48db-91ee-acae4b94028a service nova] Creating event network-changed:6758173a-c05b-4dbe-a01f-d4b556f91c47 for instance 2538c057-6851-449d-a4a4-bdce032a9be8 on hv-cinder-79400 Jan 26 19:25:28.859343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-8f9d848a-7e42-4bab-ad09-a95de0fc1b63 req-72a854c9-3f49-48db-91ee-acae4b94028a service nova] Acquired lock "compute-rpcapi-router" {{(pid=116106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 26 19:25:28.860922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.861525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.863038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.864344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.878060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.compute.rpcapi [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 26 19:25:28.880692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] Releasing lock "compute-rpcapi-router" {{(pid=116106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 26 19:25:28.914074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-44b00583-dc15-44ec-9754-23c2767e3981 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367316 Jan 26 19:25:28.916871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 32/57] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:28.925277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:28.926762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:28.938670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.939638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:28.940846 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:28.943893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.202341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:29.215704 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a14b45f2-509c-4a04-ae93-645777771f07 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.793261 Jan 26 19:25:29.216482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 26/58] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:28 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:29.226591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:29.228239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:29.240026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:29.240470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.241308 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:29.244354 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.336796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:29.345249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-863f449c-76f8-48c2-aefa-b0647c2b8247 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.426950 Jan 26 19:25:29.346292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 33/59] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:28 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:29.351593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-6d8382bc-8224-48c5-a47c-1d99ec01285b req-2d2bc57c-5e41-42ab-8bcc-9c8de72b65c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d757f9bf-0099-40a5-aa9d-9c174a3ac859", "tag": "1b7adc2f-208b-4133-b88e-b377af0b7104"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:29.354159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:29.354159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:25:29.369691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6d8382bc-8224-48c5-a47c-1d99ec01285b req-2d2bc57c-5e41-42ab-8bcc-9c8de72b65c0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:29.370289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6d8382bc-8224-48c5-a47c-1d99ec01285b req-2d2bc57c-5e41-42ab-8bcc-9c8de72b65c0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.398636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-6d8382bc-8224-48c5-a47c-1d99ec01285b req-2d2bc57c-5e41-42ab-8bcc-9c8de72b65c0 service nova] Creating event network-changed:1b7adc2f-208b-4133-b88e-b377af0b7104 for instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 on hv-cinder-79400 Jan 26 19:25:29.416655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-6d8382bc-8224-48c5-a47c-1d99ec01285b req-2d2bc57c-5e41-42ab-8bcc-9c8de72b65c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068135 Jan 26 19:25:29.422622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 34/60] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:29.437206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:29.438252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:29.454417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:29.455684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.457104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:29.458908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:29.794415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:29.804571 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:29.811955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:29.813130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-af1dac1a-943c-4494-a2b4-8085abf864d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.592802 Jan 26 19:25:29.813701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 27/61] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:29 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:30.171825 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:30.182452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b475a4bd-6edb-4958-a9f6-bc0db30cd465 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.754854 Jan 26 19:25:30.184162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 35/62] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:29 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:30.232170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:30.232851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:30.243565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.244294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:30.245336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.249568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:30.367629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:30.368304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:30.376706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.377238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:30.378127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.378822 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:30.863950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:30.873211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-002c4e48-4503-4804-853a-9f24620207e0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.511364 Jan 26 19:25:30.873797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 36/63] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:30 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:30.893207 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:30.897145 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:30.916765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.917230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:30.918026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:30.918464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.132557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:31.152888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a9529578-a0b4-43d6-91d1-fe62bf78dadc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.924657 Jan 26 19:25:31.154351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 28/64] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:30 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:31.161806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f0e8635f-9685-4ff2-9ce1-ab3c1d2d92f0 req-718b99a8-18a5-41aa-8863-8103a656b9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:31.171510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:31.171510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:25:31.192355 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f0e8635f-9685-4ff2-9ce1-ab3c1d2d92f0 req-718b99a8-18a5-41aa-8863-8103a656b9bb service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.193006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f0e8635f-9685-4ff2-9ce1-ab3c1d2d92f0 req-718b99a8-18a5-41aa-8863-8103a656b9bb service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.205766 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f0e8635f-9685-4ff2-9ce1-ab3c1d2d92f0 req-718b99a8-18a5-41aa-8863-8103a656b9bb service nova] Creating event network-changed:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:25:31.212511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f0e8635f-9685-4ff2-9ce1-ab3c1d2d92f0 req-718b99a8-18a5-41aa-8863-8103a656b9bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055710 Jan 26 19:25:31.213533 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 29/65] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:31.221047 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:31.221946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:31.229437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.230125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.231486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.232180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.339552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:31.348148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:31.361173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:31.362485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-282380ee-06fc-4a48-9916-8eb4eab4695b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.473589 Jan 26 19:25:31.363310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 37/66] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:30 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:31.473633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-857b8032-6f8f-466b-a37c-8e0f1ace04a4 req-19b69b09-047f-479e-ad07-c87da30b9351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91511721-4987-4610-a541-9b2aee7248eb", "tag": "5caae4f3-a4db-4e20-a9d4-2446fc03ad58"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:31.475353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:31.475353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:25:31.488412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-857b8032-6f8f-466b-a37c-8e0f1ace04a4 req-19b69b09-047f-479e-ad07-c87da30b9351 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.488921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-857b8032-6f8f-466b-a37c-8e0f1ace04a4 req-19b69b09-047f-479e-ad07-c87da30b9351 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.514919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-857b8032-6f8f-466b-a37c-8e0f1ace04a4 req-19b69b09-047f-479e-ad07-c87da30b9351 service nova] Creating event network-changed:5caae4f3-a4db-4e20-a9d4-2446fc03ad58 for instance 91511721-4987-4610-a541-9b2aee7248eb on hv-cinder-79400 Jan 26 19:25:31.532303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-857b8032-6f8f-466b-a37c-8e0f1ace04a4 req-19b69b09-047f-479e-ad07-c87da30b9351 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061950 Jan 26 19:25:31.533379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 38/67] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:31.795473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:31.805369 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1812bfc6-8e5b-4e85-b0a2-4bfaf10684a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.589419 Jan 26 19:25:31.806345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 30/68] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:31 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:31.890894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:31.891581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:31.898018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.899206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:31.900785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:31.901552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.065720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:32.074615 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8ce854d-9089-411f-8c5c-9eecd9fdea8f tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.187622 Jan 26 19:25:32.084452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 39/69] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:31 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:32.170277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:32.171520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:32.178086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.178639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.179550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.180172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.383379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:32.384720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:32.393374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.395540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.396717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.397435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.425115 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:32.435215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4ebaf4b6-0b7f-402d-ad0d-b68299b04259 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.268547 Jan 26 19:25:32.435690 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 31/70] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:32 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:32.615486 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:32.628791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:32.630642 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:32.633372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a62ba8da-c685-4e84-8300-42a4b04d3f27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.253330 Jan 26 19:25:32.642777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 40/71] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:32 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:32.825943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:32.826846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:32.838777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.839947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:32.841139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:32.841772 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.094514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:33.095499 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:33.105268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.106032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.106990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.108109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.296603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.304002 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1d3c134a-d4fa-4507-bff2-47bef6f8781a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.215279 Jan 26 19:25:33.304556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 41/72] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:33 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:33.453394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.455835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:33.458263 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:33.465449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-618e2c70-4c6d-4db0-a022-c4bb180468fc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.646121 Jan 26 19:25:33.466279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 32/73] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:32 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:33.475293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.475293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.475293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.475293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.614274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.623898 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-24d41a6a-25bc-4cec-b191-808b1950c210 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.174114 Jan 26 19:25:33.624614 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 42/74] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:33 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:33.648838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:33.649502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:33.656045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.656491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.657259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:33.657673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:33.802073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.810286 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.811863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:33.812881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d7adeb94-cb85-4f6a-ad4c-a8a978335cb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.167964 Jan 26 19:25:33.813761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 33/75] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:33 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:34.321246 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:34.321929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:34.330098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.330623 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.331407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.331886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.468720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.475835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4ccaf629-0306-44e9-b5fd-d02206088e51 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.159260 Jan 26 19:25:34.476391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 43/76] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:34 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:34.482800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:34.483402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:34.489090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.489532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.490298 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.490727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.640730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:34.641341 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:34.647084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.647540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.648680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.649169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.707161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.715876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-05210153-46bf-4bfa-983d-4f8082eff138 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.236649 Jan 26 19:25:34.716455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 34/77] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:34 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:34.776791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.784066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fc819571-8196-43e4-ba16-72fe6ec36579 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.146867 Jan 26 19:25:34.784639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 44/78] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:34 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:34.831455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:34.832017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:34.838428 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.838874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.839676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:34.840252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:34.967197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.975054 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.976611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:34.977705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-39950513-0878-45ae-9c5f-8fe8b5b6765d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.149982 Jan 26 19:25:34.978269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 35/79] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:34 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:35.492244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:35.493571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:35.519311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.520078 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.520874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.521309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.650905 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:35.658289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9cf70422-9b0c-4f3b-89e2-c41fc9a2e40e tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.169822 Jan 26 19:25:35.658864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 45/80] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:35 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:35.733328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:35.734637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:35.740400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.740945 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.741776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.742270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.800774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:35.801769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:35.808723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.809248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.810162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:35.810847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:35.883491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:35.893960 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99664166-637b-4d69-b1f7-fa1e5bc83f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.164315 Jan 26 19:25:35.894885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 36/81] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:35 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:35.963234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:35.970693 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-35c9953e-8331-4ed3-bc72-d61d98513ef9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.173997 Jan 26 19:25:35.971259 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 46/82] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:35 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:35.995067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:35.995666 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:36.001791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.002318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.003196 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.003700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.138991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:36.146664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:36.148187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:36.150134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1f83a781-2e38-4692-aaea-b301e0f70532 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.158130 Jan 26 19:25:36.150688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 37/83] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:35 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:36.674716 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:36.675321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:36.681524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.681966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.682735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.683167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.912033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:36.913324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:36.927849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.931281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.933041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:36.935325 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:36.999119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.007046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eb2a978a-7973-4467-a674-bd6a12c0a22c tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.336028 Jan 26 19:25:37.013278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 47/84] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:36 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:37.013278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:37.020398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:37.027539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:37.028020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:37.028800 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:37.029236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:37.124893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.133387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-64088ba9-dced-4d80-8bf9-d41e5414ef56 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.225580 Jan 26 19:25:37.134305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 38/85] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:36 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:37.168173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.170183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:37.170819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:37.176386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-668d213a-2818-4561-9133-7f33dc66f84a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.167744 Jan 26 19:25:37.177353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 48/86] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:37 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:37.179040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:37.179685 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:37.181323 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:37.182361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:37.318091 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.325929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.327418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:37.328534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-92e20526-ae41-4690-a7da-da399c1acd2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.163926 Jan 26 19:25:37.329092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 39/87] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:37 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:38.025014 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:38.025743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:38.032113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.032645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.033493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.034028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.150017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:38.150928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:38.158330 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.160198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.161454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.162111 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.195437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.204158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a18b13a7-8411-44ee-97e6-47540cea38e6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.183889 Jan 26 19:25:38.214104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 49/88] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:38 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:38.219467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:38.220112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:38.226346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.226803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.227641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.228113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.370162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.373090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.377801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3eae757f-8cbc-47b1-be94-2f478ddc4b06 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.162747 Jan 26 19:25:38.378376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 50/89] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:38 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:38.382916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:38.385113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:38.389710 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.390082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6a40392-b3e2-4222-bfe4-3ab7274a9662 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.243916 Jan 26 19:25:38.390210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.390842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 40/90] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:38 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:38.390961 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:38.391347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:38.519960 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.528381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.530706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:38.532036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-72215026-1ef8-465b-97c1-23ccd5f2fad5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.152563 Jan 26 19:25:38.532668 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 51/91] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:38 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:39.221454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:39.222034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:39.228657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.229106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.229937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.230316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.378867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.387293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f7b85ea0-3544-4b7f-851c-97666ed77139 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.169809 Jan 26 19:25:39.387908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 41/92] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:39 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:39.401004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:39.401760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:39.407871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.408452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.409230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.409824 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.410868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:39.412285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:39.421069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.421710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.422684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.423118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.575470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.584174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-20951848-28de-4ea1-a10c-504e7f8b8bc2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.193119 Jan 26 19:25:39.584916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 52/93] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:39 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:39.589904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:39.590662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:39.596964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.597415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.598257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:39.598903 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:39.602642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.612522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-89d70d3e-b0f9-45f6-a347-0e9a7d26e2a1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.206704 Jan 26 19:25:39.613995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 42/94] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:39 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:39.746732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.767180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.774956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:39.776402 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-07f1661c-6dca-4d92-aade-6ababedb3216 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.190389 Jan 26 19:25:39.777090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 53/95] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:39 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:40.405454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:40.406183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:40.411948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.412420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.413179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.413601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.544871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.552130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-081d7029-7e47-4dd0-9af2-6cf6e6d70fd9 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.150201 Jan 26 19:25:40.552686 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 43/96] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:40 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:40.601209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:40.601901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:40.608644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.609096 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.609877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.610315 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.630340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:40.631050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:40.636901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.637342 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.638104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.638531 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.753379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.763386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-277476d8-b145-4c8e-aa8b-cdfbfa645d14 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.165774 Jan 26 19:25:40.764752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 54/97] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:40 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:40.792163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.796353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:40.797767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:40.799995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a0123cb0-b9ed-4500-8924-aeaca94c1166 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.173383 Jan 26 19:25:40.800649 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 44/98] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:40 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:40.813865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.814684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.815462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:40.815917 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:40.952957 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.961433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.964204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:40.965328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-97574573-5426-4b23-903b-d6250fd9fa75 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.174996 Jan 26 19:25:40.966042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 55/99] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:40 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:41.568362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:41.569155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:41.575219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.575742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.576565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.576996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.712518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:41.719788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-03a7f7ff-6c46-45c6-8164-e8830fd5e338 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.155076 Jan 26 19:25:41.720371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 45/100] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:41 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:41.780655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:41.781383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:41.787174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.787613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.788409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.788836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.816835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:41.817502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:41.826143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.826715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.827697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.828165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.926242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:41.934004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7e7fcda8-eda5-41a8-a1e4-2dce6c778a85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.156671 Jan 26 19:25:41.935228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 56/101] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:41 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:41.972152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:41.980071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b060d8bb-1c85-4615-8ac1-a8a688e6b9e4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.167006 Jan 26 19:25:41.980644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 46/102] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:41 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:41.983943 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:41.983943 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:41.989546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.990072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:41.990911 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:41.991410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:42.122413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:42.130193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:42.131683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:42.132792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-10a72eb0-c799-4754-b978-f018951f41ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.153672 Jan 26 19:25:42.133410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 57/103] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:41 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:42.736771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:42.737388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:42.744049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:42.744495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:42.745253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:42.745681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:42.889052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:42.896154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0ea7b611-4dfd-4793-83ea-3cf8ca5ae0f7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.162965 Jan 26 19:25:42.896721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 47/104] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:42 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:42.951087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:42.951625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:42.959154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:42.959650 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:42.960485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:42.960927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:42.996824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:42.997427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:43.003244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.003696 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:43.004510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.004944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:43.094648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:43.102849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b189257c-b423-4551-a83e-9d338b64edf3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.155034 Jan 26 19:25:43.103407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 58/105] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:42 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:43.134898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:43.142250 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e05bdfaf-b7bb-45b9-83f3-35b9c207e509 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.149463 Jan 26 19:25:43.142803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 48/106] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:42 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:43.150314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:43.150895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:43.156718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.157163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:43.157933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.158361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:43.285456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:43.293545 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:43.295043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:43.296147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e985cd18-53cc-44ab-82d3-2372ffbc12be tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.149749 Jan 26 19:25:43.296704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 59/107] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:43 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:43.914061 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:43.914695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:43.920625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.921069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:43.921831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:43.922262 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.049932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.057489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-96250b9b-5775-406c-b51a-464d29b143f6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.147064 Jan 26 19:25:44.058061 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 49/108] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:43 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:44.118540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:44.119143 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:44.125333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.125772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.126595 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.127024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.158274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:44.158898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:44.165150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.165600 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.166374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.166803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.268131 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.276883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3331167f-c03d-4a74-8a9b-b0988526461b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.162417 Jan 26 19:25:44.279059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 60/109] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:44 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:44.316882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:44.320381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:44.320520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.328800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9d799499-dc5a-40ae-9c08-fbfd0eb5eeb0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.174192 Jan 26 19:25:44.330170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.330688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.337307 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:44.337307 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:44.338674 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 50/110] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:44 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:44.494680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.505614 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.507362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:44.510432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9798cec1-140e-4d6e-827b-b330416ef9c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.198910 Jan 26 19:25:44.511075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 61/111] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:44 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:45.074772 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:45.075640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:45.082736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.083580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.084575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.084987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.296253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:45.297794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:45.299045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:45.309162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.310171 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc67484a-fd8c-49a7-8d22-650165f3af5d tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.239842 Jan 26 19:25:45.310843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.311952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 51/112] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:45 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:45.315923 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.317541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.420437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-1d9658ed-623d-41b8-8380-46a8583bc129 req-b5cc3f95-bcf8-4c8b-84e2-f94a5234ef72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2538c057-6851-449d-a4a4-bdce032a9be8", "name": "network-vif-plugged", "status": "completed", "tag": "6758173a-c05b-4dbe-a01f-d4b556f91c47"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:45.422506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:45.422506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:25:45.433746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-1d9658ed-623d-41b8-8380-46a8583bc129 req-b5cc3f95-bcf8-4c8b-84e2-f94a5234ef72 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.434417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-1d9658ed-623d-41b8-8380-46a8583bc129 req-b5cc3f95-bcf8-4c8b-84e2-f94a5234ef72 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.456897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-1d9658ed-623d-41b8-8380-46a8583bc129 req-b5cc3f95-bcf8-4c8b-84e2-f94a5234ef72 service nova] Creating event network-vif-plugged:6758173a-c05b-4dbe-a01f-d4b556f91c47 for instance 2538c057-6851-449d-a4a4-bdce032a9be8 on hv-cinder-79400 Jan 26 19:25:45.464635 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-1d9658ed-623d-41b8-8380-46a8583bc129 req-b5cc3f95-bcf8-4c8b-84e2-f94a5234ef72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141135 Jan 26 19:25:45.465510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 52/113] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:45.472620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:45.473393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:45.484325 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.485091 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.486083 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.487169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.516592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:45.530462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-57334429-337e-45a8-91f1-c1fb8f1e253c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.238550 Jan 26 19:25:45.531268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 62/114] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:45 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:45.536122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:45.536815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:45.544660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.545103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.545864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:45.546459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:45.842931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:45.850252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d9a3510c-7872-4fb0-adf9-7e5eb65ceebb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.383124 Jan 26 19:25:45.850821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 53/115] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:45 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:46.046855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:46.055191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:46.060741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:46.062085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-43c6f70b-5470-485a-b65b-7891bd52eed7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.529720 Jan 26 19:25:46.062792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 63/116] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:45 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:46.329907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:46.331406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:46.367021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.368338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:46.369915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.370507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:46.518996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:46.525578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-070116aa-77ce-4e04-8b38-51fe29212e88 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.201389 Jan 26 19:25:46.526267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 54/117] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:46 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:46.547211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:46.547830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:46.553826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.554254 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:46.555645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.556144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:46.702647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:46.710918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7a0675bf-5b73-43f0-ad60-f4c6dbecab1a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.167291 Jan 26 19:25:46.711593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 64/118] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:46 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:46.867191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:46.868389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:46.874172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.874617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:46.875386 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:46.875841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.003751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:47.010977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0e6b19b1-008e-4cef-bb08-ed274884d202 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.147373 Jan 26 19:25:47.011545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 55/119] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:46 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:47.089510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:47.089510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:47.095422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.095905 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.096683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.097118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.227885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:47.239346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:47.241055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:47.242438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-012e9eb1-77f7-43b4-9a9a-4005b769c9fc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.157237 Jan 26 19:25:47.243006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 65/120] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:47 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:47.504502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d757f9bf-0099-40a5-aa9d-9c174a3ac859", "name": "network-vif-plugged", "status": "completed", "tag": "1b7adc2f-208b-4133-b88e-b377af0b7104"}, {"server_uuid": "c83ec467-f057-4a9b-91c7-302bc3507bf2", "name": "network-vif-plugged", "status": "completed", "tag": "1a5716f6-ee7f-47b4-9680-f7b8772235cd"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:47.506492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:47.506492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:25:47.515665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.516193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.531924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] Creating event network-vif-plugged:1b7adc2f-208b-4133-b88e-b377af0b7104 for instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 on hv-cinder-79400 Jan 26 19:25:47.532720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] Creating event network-vif-plugged:1a5716f6-ee7f-47b4-9680-f7b8772235cd for instance c83ec467-f057-4a9b-91c7-302bc3507bf2 on hv-cinder-79400 Jan 26 19:25:47.541285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-af43775b-b077-4f08-8806-17c4e376c653 req-59c86b33-1e07-4e0b-a329-e8e2e9050e37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042683 Jan 26 19:25:47.542068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 56/121] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:47.543222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:47.543873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:47.551173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.551793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.552680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.553476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.731162 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:47.731899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:47.742359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.746117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.749716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:47.750567 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:47.751557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:47.763220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b246ff16-fcd4-4108-871a-a216eb485532 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.224285 Jan 26 19:25:47.764081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 66/122] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:47 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:48.029479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:48.030539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:48.056284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.056284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.056284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.056284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.292126 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.295138 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.299835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b92c6cec-17ac-4922-82c4-c6810a1b3eb2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1361 microversion: 2.1 time: 0.275608 Jan 26 19:25:48.300415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 67/123] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:48 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:48.304006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2da682a3-5237-488f-af23-b01bf2a69c85 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.578921 Jan 26 19:25:48.310552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:48.310552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:48.312017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 57/124] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:47 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:48.314806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.315257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.316123 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.316741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.451682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.459874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.461502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.462608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6bdd871b-1006-4009-b34a-ef272601a62b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.161288 Jan 26 19:25:48.463431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 68/125] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:48 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:48.783030 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:48.783659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:48.791473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.792111 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.793195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:48.793784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:48.972740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:48.981261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6aa960f-79cf-40ca-adb1-2a149d604cee tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1314 microversion: 2.1 time: 0.204182 Jan 26 19:25:48.981981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 58/126] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:48 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:49.322096 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:49.322704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:49.323388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:49.324025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:49.329466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.330092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.331460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.332083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.332431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.332879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.333659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.334086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.548510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:49.569225 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-28d64758-ce64-4228-8b34-d88e05bde2c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1548 microversion: 2.1 time: 0.253468 Jan 26 19:25:49.570528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 69/127] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:49 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1548 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:49.577058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:49.578256 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:49.598514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.599172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.600213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.600914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.643551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:49.658163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ed7547ce-907a-4cf3-9838-57fcafe85798 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.337458 Jan 26 19:25:49.659692 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 59/128] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:49 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:49.674576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "name": "network-vif-plugged", "status": "completed", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}, {"server_uuid": "91511721-4987-4610-a541-9b2aee7248eb", "name": "network-vif-plugged", "status": "completed", "tag": "5caae4f3-a4db-4e20-a9d4-2446fc03ad58"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:49.676490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:49.676490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:25:49.687488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.688516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.705450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] Creating event network-vif-plugged:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:25:49.706195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] Creating event network-vif-plugged:5caae4f3-a4db-4e20-a9d4-2446fc03ad58 for instance 91511721-4987-4610-a541-9b2aee7248eb on hv-cinder-79400 Jan 26 19:25:49.713875 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f1997e95-1841-437c-a828-7ebfc14ff79a req-9a1d7a7e-431b-4fca-ae49-5cac5ee47a6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052575 Jan 26 19:25:49.714486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 60/129] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:49.721896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:49.722646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:49.730397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.730848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.732273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:49.732722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:49.817716 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:49.826578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:49.828362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:49.829521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3b60f615-7b8d-43a8-9ad5-08b0151d725f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.257161 Jan 26 19:25:49.830397 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 70/130] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:49 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:49.917702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c19d17af-b33b-4162-b825-67b7db265a23 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201792 Jan 26 19:25:49.918601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 61/131] 10.222.0.50 () {58 vars in 1274 bytes} [Wed Jan 26 19:25:49 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:49.999027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:50.000471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:50.011933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.012390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.014786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.015426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.331426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:50.339659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7ccd288b-fe76-42a9-9dbf-792a56ef2fe8 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1501 microversion: 2.1 time: 0.344747 Jan 26 19:25:50.340401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 71/132] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:49 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:50.676411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:50.684572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:50.710166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.713132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.714172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.715175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.851031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:50.851687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:50.872026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.877100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.878297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:50.880966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:50.926022 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:50.935930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c946c786-20cc-4258-822b-f2ca0409d0e7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.264239 Jan 26 19:25:50.936518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 62/133] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:50 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:51.181780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:51.190876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:51.192717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:51.193986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5e35e087-ee3c-45a3-bdf4-cdc58d167efd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.349811 Jan 26 19:25:51.194755 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 72/134] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:50 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:51.536174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:51.537099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:51.545310 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:51.546010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:51.546987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:51.547608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:51.548249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-81226a78-7fee-457f-9aed-69b957fe6ca0 req-ca4a812b-a9a3-4244-9495-fa76821611df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2538c057-6851-449d-a4a4-bdce032a9be8", "tag": "6758173a-c05b-4dbe-a01f-d4b556f91c47"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:51.549845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:51.549845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:25:51.558057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-81226a78-7fee-457f-9aed-69b957fe6ca0 req-ca4a812b-a9a3-4244-9495-fa76821611df service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:51.558509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-81226a78-7fee-457f-9aed-69b957fe6ca0 req-ca4a812b-a9a3-4244-9495-fa76821611df service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:51.569804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-81226a78-7fee-457f-9aed-69b957fe6ca0 req-ca4a812b-a9a3-4244-9495-fa76821611df service nova] Creating event network-changed:6758173a-c05b-4dbe-a01f-d4b556f91c47 for instance 2538c057-6851-449d-a4a4-bdce032a9be8 on hv-cinder-79400 Jan 26 19:25:51.575111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-81226a78-7fee-457f-9aed-69b957fe6ca0 req-ca4a812b-a9a3-4244-9495-fa76821611df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030303 Jan 26 19:25:51.578847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 73/135] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:51.953867 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:51.954850 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:51.962392 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:51.963045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:51.963966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:51.964476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:52.135262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:52.142496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-50970ed5-455d-4923-80a9-979f73f09902 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.192689 Jan 26 19:25:52.142989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 74/136] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:51 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:52.213285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:52.213875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:52.219578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:52.220042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:52.220803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:52.221226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:52.360874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:52.369393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:52.370892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:52.372035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c8b5897c-085b-42fa-ba46-352b9cb83bff tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.163009 Jan 26 19:25:52.372605 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 75/137] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:52 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:53.159596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:53.160216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:53.166591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:53.167026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:53.167788 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:53.168250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:53.294276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:53.301512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9de7fe02-57e4-4ca8-99fb-f0c7e444997a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.145467 Jan 26 19:25:53.302070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 76/138] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:53 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:53.389275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:53.389864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:53.395638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:53.396107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:53.396862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:53.397313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:53.526711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:53.534317 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:53.535833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:53.536919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0a16562b-8d14-4d9f-844d-b72528831ec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.151272 Jan 26 19:25:53.537482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 77/139] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:53 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:54.318663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:54.319249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:54.325256 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:54.325706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:54.326477 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:54.326915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:54.456666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:54.463724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0d3e7494-8203-4683-9085-87885b752c80 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.148676 Jan 26 19:25:54.464308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 78/140] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:54 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:54.553258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:54.553879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:54.560149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:54.560594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:54.561373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:54.561810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:54.686077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:54.693592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:54.695111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:54.696375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bafc150d-5ff7-4e19-b494-9c659e516640 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.146590 Jan 26 19:25:54.696980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 79/141] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:54 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:55.479950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:55.480576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:55.486768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:55.487208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:55.488016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:55.488443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:55.612159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:55.620764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bd9dda4c-adc3-4d92-b6d7-ff9003c9e43a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.143995 Jan 26 19:25:55.621322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 80/142] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:55 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:25:55.713341 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:55.713926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:55.719566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:55.720028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:55.720782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:55.721206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:55.860862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:55.868712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:55.870856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:55.871997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b321e6b7-84a1-4413-b773-1bc65aec6160 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.162149 Jan 26 19:25:55.872550 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 81/143] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:55 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:25:55.934447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e3c2e8af-28b6-4ed8-96c8-5ec478372efb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 4.401512 Jan 26 19:25:55.935110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 63/144] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:25:51 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 4403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:25:56.638012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:56.638608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:56.644877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.645314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:56.646079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.646501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:56.779744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:56.786870 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-60a80f7e-6ee1-4087-8ac5-1be8c0876005 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1321 microversion: 2.1 time: 0.153356 Jan 26 19:25:56.787436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 82/145] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:56 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:56.890495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:56.891227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:56.898702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.899169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:56.899954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.900391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:56.945257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:56.946220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:56.952158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.952608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:56.953386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:56.953823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.043164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:57.051700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:57.053404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:57.054504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ace26bbc-af92-4ee9-bd74-388e4c745fe5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1407 microversion: 2.20 time: 0.168359 Jan 26 19:25:57.055063 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 64/146] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:56 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:57.059579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5318ebfc-954e-4c55-a70c-a0634b3e2666"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:57.060700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:57.066441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.066889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.067667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.068125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.071627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-86150f23-d5e2-43cf-a572-6556815dc5cc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.129851 Jan 26 19:25:57.075152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 83/147] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:25:56 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 26 19:25:57.382580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce0cb94b-8826-4c3e-a7b2-a5f7eb0870a0 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "POST /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326303 Jan 26 19:25:57.383356 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 65/148] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:25:57 2022] POST /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:25:57.804985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:57.805557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:57.812641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.813083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.813859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.814286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.955538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:57.963227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-87ace7c0-2a85-4a4e-a4dc-8924df2f8a8b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1515 microversion: 2.1 time: 0.162411 Jan 26 19:25:57.964553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 84/149] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:57 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:57.982574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:57.983868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:57.990236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.990697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:57.991614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:57.992148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.016449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lazy-loading 'flavor' on Instance uuid 91511721-4987-4610-a541-9b2aee7248eb {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:25:58.072378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:58.072892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:58.079527 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.079966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.080756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.081166 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.139373 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-16fc74a1-6e95-448f-85a0-9ec1f78f77f7 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb/action" status: 200 len: 32 microversion: 2.1 time: 0.161993 Jan 26 19:25:58.140283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 66/150] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:25:57 2022] POST /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:25:58.145018 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:58.146831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:58.153704 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.154733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.155586 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.156178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.238609 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6352648-b44b-4a20-bc63-395a04ed055b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.096956 Jan 26 19:25:58.238849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:58.239170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 67/151] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:25:58 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:25:58.245811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:58.246726 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:58.249733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:58.251340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:58.252628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8059794e-0a99-41af-8da7-7baa3a5ff939 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1598 microversion: 2.20 time: 0.184029 Jan 26 19:25:58.253810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 85/152] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:25:58 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:25:58.255231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.255732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.256788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.257364 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.274465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:58.275079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:58.281947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.282495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.283346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:58.283874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:58.388302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-71753a26-6cc2-4a24-a2cb-b27d48985efe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.120372 Jan 26 19:25:58.388890 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 86/153] 10.222.0.50 () {60 vars in 1315 bytes} [Wed Jan 26 19:25:58 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:25:58.692618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:58.702327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8aa20aed-3ab8-446f-b2a4-eafee95bfed8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.461766 Jan 26 19:25:58.703402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 68/154] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:58 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:59.250187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:59.251112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:59.256906 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.257352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.258117 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.258547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.329876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-90e508c1-82aa-4747-8d85-fdb035c88673 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.084135 Jan 26 19:25:59.330695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 87/155] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:25:59 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:25:59.551178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:59.551922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-c4a1b4f9-f0af-4ff2-9ba5-fc85e33e9723 req-21a7fa37-430a-42f6-9353-be48d2b20a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:25:59.552315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:59.554761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:25:59.554761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:25:59.560575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.561089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.561937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.562443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.584280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c4a1b4f9-f0af-4ff2-9ba5-fc85e33e9723 req-21a7fa37-430a-42f6-9353-be48d2b20a85 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.585093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c4a1b4f9-f0af-4ff2-9ba5-fc85e33e9723 req-21a7fa37-430a-42f6-9353-be48d2b20a85 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.600299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-c4a1b4f9-f0af-4ff2-9ba5-fc85e33e9723 req-21a7fa37-430a-42f6-9353-be48d2b20a85 service nova] Creating event network-changed:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:25:59.605378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-c4a1b4f9-f0af-4ff2-9ba5-fc85e33e9723 req-21a7fa37-430a-42f6-9353-be48d2b20a85 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057631 Jan 26 19:25:59.605959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 88/156] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:25:59.641423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f352814c-cfd8-4b73-9a8c-51922dced22b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.093875 Jan 26 19:25:59.643816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 69/157] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:25:59 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:25:59.722564 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:25:59.723697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:25:59.733351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.738095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.739300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:25:59.739989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:25:59.901734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:25:59.911205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-96d223d4-c214-408b-9e11-4d3324e89b39 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.194255 Jan 26 19:25:59.921079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 89/158] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:25:59 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:00.341209 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:00.342246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:00.361017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.361017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:00.361822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.362254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:00.460722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-035bb48b-912b-4cf8-bd42-09b6e7e5d648 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.123686 Jan 26 19:26:00.461361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 70/159] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:00 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:26:00.654310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:00.655262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:00.669151 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.669620 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:00.670421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.670861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:00.756473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a1d75238-d6c1-4f87-aa15-cc921502297c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.107347 Jan 26 19:26:00.757187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 90/160] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:00 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:00.930679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:00.931470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:00.938198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.940915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:00.942344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:00.943110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:01.116140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:01.123568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4ae3deed-59cb-4c3a-aa25-dd889ce254af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.199275 Jan 26 19:26:01.124170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 71/161] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:00 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:01.472206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:01.473114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:01.480429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:01.481199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:01.482004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:01.482519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:01.570804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-290c83c2-2416-4928-8607-89a9adce76ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.102523 Jan 26 19:26:01.571476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 91/162] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:01 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:26:01.766551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:01.767822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:01.777120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:01.777120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:01.777120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:01.777120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:01.863253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ad0c9632-5f48-42f1-ab8c-b80aa2361cc9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.099926 Jan 26 19:26:01.864507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 72/163] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:01 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:02.140803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:02.141501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:02.152713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.153354 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.154517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.155516 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.337235 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:02.349340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c0ef7e41-0a31-4043-ba91-1320e6463ae3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.212447 Jan 26 19:26:02.350506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 92/164] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:02 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:02.582068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:02.583075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:02.590961 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.591450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.592303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.592745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.675705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a0e2d476-adce-4a59-b27b-9bac96cebd20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.097443 Jan 26 19:26:02.678686 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 73/165] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:02 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:26:02.875052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:02.876000 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:02.882132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.882582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.883361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:02.883840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:02.955010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-03555fe3-8049-45a9-9657-e8e90d983c9b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.083561 Jan 26 19:26:02.958321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 93/166] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:02 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:03.367167 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:03.368113 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:03.376293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.376859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:03.377855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.378386 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:03.538312 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:03.547413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3277b848-6405-495b-847b-67beb3bad171 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.184213 Jan 26 19:26:03.548020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 74/167] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:03 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:03.686681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:03.687864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:03.694708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.695113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:03.695909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.696352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:03.785853 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7a566168-6731-401c-b171-f0328b3011ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14 microversion: 2.1 time: 0.102941 Jan 26 19:26:03.789556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 94/168] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:03 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:26:03.966854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:03.967863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:03.974013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.974460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:03.975280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:03.975709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:04.061563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8b29dd4f-45b0-459a-8b62-ff84235429a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.099220 Jan 26 19:26:04.065128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 75/169] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:03 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:04.565060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:04.566156 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:04.575885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:04.576508 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:04.577625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:04.578079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:04.709937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:04.717655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c43f0d43-8e34-441c-a4d5-ff1b4c423d62 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.157167 Jan 26 19:26:04.718216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 95/170] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:04 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:04.797080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:04.797997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:04.811599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:04.812071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:04.812848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:04.813329 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:04.924393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f93c79b1-f780-40ab-8216-c1f4b9fdfa03 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 4219 microversion: 2.1 time: 0.131934 Jan 26 19:26:04.925023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 76/171] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:04 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 4219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:05.073663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:05.075267 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:05.081696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.082139 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.082907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.083332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.161064 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d3ad7560-d651-4560-b42c-ce55ab42cc82 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.092333 Jan 26 19:26:05.161691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 96/172] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:05 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:05.735113 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:05.735852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:05.742851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.743285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.744488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.745082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.937722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:05.938725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:05.950660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.951365 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.952451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:05.953062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:05.990608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:06.010631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-17f6e6a8-993d-492e-9b08-9b08c2a2a2c3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.279642 Jan 26 19:26:06.011246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 77/173] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:05 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:06.172521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:06.173515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:06.180405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:06.180880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:06.181639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:06.182215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:06.211763 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f621a086-c257-4346-9189-28c4c5516ed7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 6451 microversion: 2.1 time: 0.279605 Jan 26 19:26:06.212583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 97/174] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:05 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 6451 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:06.259988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-03913d02-c26e-45f8-a325-0ac9e8b412df tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.090935 Jan 26 19:26:06.261886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 78/175] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:06 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:07.028412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:07.029489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:07.038550 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.039192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.040067 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.049330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.072555 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:07.074437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:07.083472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.083991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.084771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.085282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.121159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:26:07.210439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:07.220425 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-40e8b501-ea1e-4d1a-be1c-43ca42f0a66e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.196787 Jan 26 19:26:07.221308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 98/176] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:07 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:07.226074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:07.227640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:07.238898 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.239590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.240400 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.240683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3404f8b0-6b49-4e5e-bce8-b51e6a64d1f2 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 204 len: 0 microversion: 2.1 time: 0.173581 Jan 26 19:26:07.240903 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.241272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 79/177] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:26:07 2022] DELETE /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:26:07.255215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:07.256584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:07.264704 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.265148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.267594 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.268217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.345300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7a904a2e-bec7-4315-b58a-31f4fc118f27 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 10080 microversion: 2.1 time: 0.122468 Jan 26 19:26:07.346227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 99/178] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:07 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 10080 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:07.351384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:07.352842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:07.366186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.366799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.367597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:07.368056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:07.424703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:07.432782 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-001c0540-00b2-488c-a754-796fd11cb7a7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1553 microversion: 2.1 time: 0.184177 Jan 26 19:26:07.433394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 80/179] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:07 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:07.454679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0d247d46-b88d-4870-a3a7-d55d19f18614 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.106916 Jan 26 19:26:07.455340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 100/180] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:07 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:08.238271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:08.238876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:08.248052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.248500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.249288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.249724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.365954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:08.366953 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:08.374945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.375396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.376247 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.376715 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.406117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:08.415281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f1c394fc-40a6-4321-a223-c6e5d46cad1f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.180710 Jan 26 19:26:08.416005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 81/181] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:08 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:08.450588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:08.451320 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:08.457098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.457620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.458461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.459021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.476149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-778b309d-cda6-4c5c-8cf6-2d921486d9de tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 14597 microversion: 2.1 time: 0.116062 Jan 26 19:26:08.477015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 101/182] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:08 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 14597 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:08.484845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:08.485862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:08.492796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.493561 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.494691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:08.495702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:08.591302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b1789269-1879-48ff-83f7-9adc609e5948 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.112754 Jan 26 19:26:08.591598 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:08.592224 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 102/183] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:08 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:08.600732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-79223ebc-8eac-4b5a-8fb5-d3fb0c311e2a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1553 microversion: 2.1 time: 0.155231 Jan 26 19:26:08.601289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 82/184] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:08 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:09.436296 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:09.437859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:09.446630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.459306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.460215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.460820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.496198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:09.497636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:09.505033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.505885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.507530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.509279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.607279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-78324781-a835-4dad-b6cd-8b62d05b6278 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 17602 microversion: 2.1 time: 0.122366 Jan 26 19:26:09.608418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 83/185] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:09 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 17602 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:09.614480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:09.615483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:09.622839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.623712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.624679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.625261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.676023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:09.683688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e402d9ef-1889-42fd-b9d4-694c310f9215 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.253995 Jan 26 19:26:09.684410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 103/186] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:09 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:09.689773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:09.690532 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:09.700484 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.700933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.701772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:09.702236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:09.717005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3e6a1c34-f47e-423f-a0e6-4c5b646e36e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.106630 Jan 26 19:26:09.718046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 84/187] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:09 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:09.844964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:09.853712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8aa8f2fd-cba5-4843-91e3-79e784129f4b tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1553 microversion: 2.1 time: 0.168385 Jan 26 19:26:09.855002 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 104/188] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:09 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:10.623069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:10.624761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:10.632544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.633273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.634381 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.635095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.704048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:10.704759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:10.711324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.711895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.713032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.713733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.717867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5139bb3e-44b6-4781-9161-8e2b58c06096 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 18155 microversion: 2.1 time: 0.099554 Jan 26 19:26:10.719181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 85/189] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:10 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 18155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:10.729835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:10.731123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:10.738641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.739283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.740271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.740860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.824185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ebc458f7-c767-4b11-a88d-7ef44b443d22 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.098869 Jan 26 19:26:10.824915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 86/190] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:10 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:10.865422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:10.872052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:10.874417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:10.876882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b1ea6c18-1d82-4204-aa82-70998f7bddba tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.176820 Jan 26 19:26:10.877883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 105/191] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:10 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:10.887013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.887471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:10.888302 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:10.888790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.084230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:11.095179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7276563a-d634-4cf4-af4e-7ac541dfa9b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1553 microversion: 2.1 time: 0.227634 Jan 26 19:26:11.109673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 87/192] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:10 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:11.177867 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-59b2b52a-91c1-4daf-b0bb-a7ac1dbc9f15 req-b431a503-c617-4157-9ba6-621989171ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83ec467-f057-4a9b-91c7-302bc3507bf2", "name": "network-vif-deleted", "tag": "1a5716f6-ee7f-47b4-9680-f7b8772235cd"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:11.180633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:26:11.180633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:26:11.190586 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-59b2b52a-91c1-4daf-b0bb-a7ac1dbc9f15 req-b431a503-c617-4157-9ba6-621989171ccf service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.192125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-59b2b52a-91c1-4daf-b0bb-a7ac1dbc9f15 req-b431a503-c617-4157-9ba6-621989171ccf service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.206687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-59b2b52a-91c1-4daf-b0bb-a7ac1dbc9f15 req-b431a503-c617-4157-9ba6-621989171ccf service nova] Creating event network-vif-deleted:1a5716f6-ee7f-47b4-9680-f7b8772235cd for instance c83ec467-f057-4a9b-91c7-302bc3507bf2 on hv-cinder-79400 Jan 26 19:26:11.214480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-59b2b52a-91c1-4daf-b0bb-a7ac1dbc9f15 req-b431a503-c617-4157-9ba6-621989171ccf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039853 Jan 26 19:26:11.215575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 106/193] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:11.729037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:11.730610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:11.738845 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.739680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.741045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.741751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.838866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c69dae32-9622-4e59-82d5-ee1b2cde1c83 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 19775 microversion: 2.1 time: 0.113263 Jan 26 19:26:11.839204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:11.840218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 88/194] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:11 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 19775 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:11.841559 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:11.848657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.849186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.850127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.850630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.895531 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:11.897159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:11.904875 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.905450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.906304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:11.906639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:11.942370 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4b8ed64f-6784-4be0-966a-67f7179351d9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.109960 Jan 26 19:26:11.943821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 107/195] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:11 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:12.112712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:12.113856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:12.128636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.129916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.131582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.132239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.144437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:12.153418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f44722f2-05d4-4958-88fe-3ea364b15987 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.262583 Jan 26 19:26:12.154383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 89/196] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:11 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:12.175546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.176552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.177423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lazy-loading 'fault' on Instance uuid c83ec467-f057-4a9b-91c7-302bc3507bf2 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:26:12.238142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa80a5e4ba714232930345e35af0f527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a0f3ad3b346df9f72a9114ea1e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:12.248811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-05555bdd-5aaa-49f4-aa1f-65b0659390d7 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 200 len: 1304 microversion: 2.1 time: 0.140790 Jan 26 19:26:12.252288 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 108/197] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:12 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:12.853501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:12.856267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:12.863800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.863800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.863800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.864140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.955436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:12.956134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe969639-bc0d-4019-9aaf-e1efcd4317d6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 21966 microversion: 2.1 time: 0.109016 Jan 26 19:26:12.956874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 90/198] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:12 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 21966 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:12.959442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:12.969019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.969802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:12.971021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:12.971526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.044839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-70728647-70e2-4a15-9034-950bbbc903c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.093599 Jan 26 19:26:13.048001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 109/199] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:12 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:13.172155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:13.172855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:13.184827 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.185286 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.186510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.187259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.268994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:13.269785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:13.278558 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.279178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.280272 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.280770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.309197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] HTTP exception thrown: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. Jan 26 19:26:13.310004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Returning 404 to user: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:13.310998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0cc9b316-d636-45aa-89d9-c60e57cac778 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 404 len: 111 microversion: 2.1 time: 0.046096 Jan 26 19:26:13.312104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 110/200] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:13 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:13.379691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:13.400359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9597ce1b-286b-4f5d-a483-10038abf8bd9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.232039 Jan 26 19:26:13.401131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 91/201] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:13 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:13.459847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:13.461517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:13.469687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.470695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.471836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.473541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.498635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] HTTP exception thrown: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. Jan 26 19:26:13.499225 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Returning 404 to user: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:13.500076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ca61b429-0036-4407-af0b-93ac2751cef5 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045404 Jan 26 19:26:13.500634 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 111/202] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:26:13 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:13.967057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:13.968419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:13.975343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.975862 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:13.976653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:13.977080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.055927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:14.056912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f67c4b72-f6f4-4ec7-acfd-dd0f3cb5bbe0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 23222 microversion: 2.1 time: 0.093952 Jan 26 19:26:14.059822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 92/203] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:13 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 23222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:14.059940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:14.065465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.065986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.066834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.067417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.132377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-48590cca-8a3b-48d4-9608-9a02c01466e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.080351 Jan 26 19:26:14.133006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 112/204] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:14 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:14.417962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:14.418658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:14.429220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.430370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.431339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.431966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.597861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:14.605667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-33922247-e8fe-419b-9bc9-1f49d77c84dd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.192321 Jan 26 19:26:14.615107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 93/205] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:14 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:14.751257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:14.752342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:14.772660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.773736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.774692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.775427 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.811810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] HTTP exception thrown: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. Jan 26 19:26:14.812727 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Returning 404 to user: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:14.814487 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-21c04f84-cbf6-4c5a-99d0-0059386200b6 tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 404 len: 111 microversion: 2.1 time: 0.070812 Jan 26 19:26:14.815202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 113/206] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:26:14 2022] DELETE /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:14.824088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:14.824922 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] [instance: c83ec467-f057-4a9b-91c7-302bc3507bf2] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:14.833542 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.833988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.836855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:14.837422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:14.857232 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] HTTP exception thrown: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. Jan 26 19:26:14.858013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] Returning 404 to user: Instance c83ec467-f057-4a9b-91c7-302bc3507bf2 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:14.858966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5b4b91df-6023-41f2-bb6c-aaa2bbaee14a tempest-DeleteServersTestJSON-1258528322 tempest-DeleteServersTestJSON-1258528322-project] 10.222.0.50 "GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2" status: 404 len: 111 microversion: 2.1 time: 0.039422 Jan 26 19:26:14.859629 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 94/207] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:14 2022] GET /compute/v2.1/servers/c83ec467-f057-4a9b-91c7-302bc3507bf2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:15.070084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:15.072568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:15.082471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.083203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.084107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.084747 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.142654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:15.144216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:15.154576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.155107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.156374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.160457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a852b5b-d5b1-4b73-86df-7526ff3f914d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 24118 microversion: 2.1 time: 0.094807 Jan 26 19:26:15.161087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.161231 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 114/208] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:15 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 24118 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:15.225990 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ede36fae-85e6-434c-8d44-497f0958a8e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 14 microversion: 2.20 time: 0.087111 Jan 26 19:26:15.230993 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 95/209] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:15 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:15.625570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:15.626322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:15.639299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.640096 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.641252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:15.642004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:15.915856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:15.942083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ba0d3661-0b92-4cca-85e9-f0f6b62e6010 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.322422 Jan 26 19:26:15.942678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 115/210] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:15 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:16.172103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:16.173289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:16.181160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.182038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:16.183505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.184173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:16.239447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:16.240537 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:16.250456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.251469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:16.252476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.253004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:16.274790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c8781066-47c1-46c7-ae88-2b45d3df3a8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 25175 microversion: 2.1 time: 0.105763 Jan 26 19:26:16.276736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 96/211] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:16 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 25175 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:16.338771 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ebe2b2d7-8227-4038-9483-07be3d88b2d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 5358 microversion: 2.20 time: 0.104523 Jan 26 19:26:16.340210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 116/212] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:16 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 5358 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:26:16.962160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:16.964000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:16.984791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.985461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:16.986484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:16.987536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:17.243910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:17.254099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5954cb93-0eef-4c63-8c29-bca4e0c72478 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.297271 Jan 26 19:26:17.255174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 97/213] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:16 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:17.289467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:17.290749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:17.310249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:17.310249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:17.310249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:17.310249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:17.350143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:17.351339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:17.367045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:17.367510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:17.373975 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:17.376689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:17.457758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-95b792d7-79cf-4418-a581-de4c7f1729a3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 26342 microversion: 2.1 time: 0.172876 Jan 26 19:26:17.458863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 117/214] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:17 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 26342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:17.509638 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd049cbc-480d-4a99-a88b-53e7673d55c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 12367 microversion: 2.20 time: 0.163269 Jan 26 19:26:17.513283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 98/215] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:17 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 12367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:18.148921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-adb4b754-28bc-4682-8d93-5af8d33e8924 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Action: 'create', calling method: .version_select at 0x7fb7c10e3dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-517148112"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:18.271902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:18.272588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:18.295881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.296610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.297819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.299359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.490817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:18.502198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd763914-2d82-4d9b-bfbb-bf196002a00a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.233727 Jan 26 19:26:18.503410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 99/216] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:18 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:18.508414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:18.509443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:18.518991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.519457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.521024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.521783 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.570491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-adb4b754-28bc-4682-8d93-5af8d33e8924 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.654797 Jan 26 19:26:18.577756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 118/217] 10.222.0.50 () {60 vars in 1154 bytes} [Wed Jan 26 19:26:17 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 657 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 26 19:26:18.577949 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:18.579665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:18.593712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.596109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.598940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:18.599492 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:18.618917 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e0dea768-dab8-4e87-8e4b-48dea350df0c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 27105 microversion: 2.1 time: 0.114056 Jan 26 19:26:18.625192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 100/218] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:18 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 27105 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:18.631719 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-55412ac3-52e0-4596-87fb-e3bb112b85a3 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c1038700>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:18.692929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-55412ac3-52e0-4596-87fb-e3bb112b85a3 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 344 microversion: 2.1 time: 0.066242 Jan 26 19:26:18.696012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 101/219] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:18 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:18.720944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a6b58b5-67e8-41d8-8c90-9e08c399a0ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 17401 microversion: 2.20 time: 0.146951 Jan 26 19:26:18.724759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 119/220] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:18 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 17401 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:19.535370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:19.536177 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:19.543763 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.544258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.545073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.545519 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.635638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:19.638066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:19.647494 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.648212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.649473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.651323 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.689182 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:19.696989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-18a837bf-6f8f-40f5-9071-3581f2e69f3c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.166494 Jan 26 19:26:19.698663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 102/221] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:19 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:19.706181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e9418167-67c2-4483-a3d0-3373a1196109 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff1e50>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:19.799279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e9418167-67c2-4483-a3d0-3373a1196109 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 344 microversion: 2.1 time: 0.096483 Jan 26 19:26:19.800035 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 103/222] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:19 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:19.804241 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:19.805193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:19.811861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.812233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.813011 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:19.813607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:19.930032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8952163-f32d-4375-b322-730a3d14349a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 27625 microversion: 2.1 time: 0.301781 Jan 26 19:26:19.931167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 120/223] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:19 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 27625 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:19.943722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ba1ba266-3033-43dc-a653-760e528048bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 18827 microversion: 2.20 time: 0.142644 Jan 26 19:26:19.945126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 104/224] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:19 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 18827 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:20.715121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:20.716072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:20.723064 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.723513 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:20.724398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.724839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:20.812206 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2aa1f724-2784-4e57-bb9c-631f906a9730 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c1a11940>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:20.856862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:20.860842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2aa1f724-2784-4e57-bb9c-631f906a9730 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 344 microversion: 2.1 time: 0.052372 Jan 26 19:26:20.861422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 105/225] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:20 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:20.864336 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1fcc6668-662a-4ee3-8e43-70e0fe9490c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.153777 Jan 26 19:26:20.864904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 121/226] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:20 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:20.943255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:20.944304 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:20.951350 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.951584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:20.952432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.952903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:20.956118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:20.957117 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:20.962958 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.963407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:20.964196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:20.964627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:23.738910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9fb7a770-e7f4-495c-805f-1ad089521c0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 27808 microversion: 2.1 time: 2.800135 Jan 26 19:26:23.739562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 106/227] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:20 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 27808 bytes in 2802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:23.744337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cfb3f002-d2f6-48bf-a030-e9e12f6f430d tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10c0d30>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:23.772338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7d7631e3-1550-491a-a617-02112a7dd22d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 25044 microversion: 2.20 time: 2.819629 Jan 26 19:26:23.777171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 122/228] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:20 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 25044 bytes in 2821 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:23.778836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:23.779459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:23.786462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:23.786943 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:23.787721 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:23.788198 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:23.790338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cfb3f002-d2f6-48bf-a030-e9e12f6f430d tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 344 microversion: 2.1 time: 0.049580 Jan 26 19:26:23.790967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 107/229] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:23 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:23.921344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:23.928515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c24aaca8-b9cc-43f3-afb6-8506839d1a45 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.154011 Jan 26 19:26:23.929068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 123/230] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:23 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:24.750915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:24.751959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:24.757995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.758444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:24.759213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.759647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:24.784664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:24.785659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:24.792625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.793076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:24.793849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.794285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:24.855424 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c2fdcce2-3dd7-4b6a-9934-6c81b1b9461f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 27874 microversion: 2.1 time: 0.108486 Jan 26 19:26:24.856117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 108/231] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:24 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 27874 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:24.860832 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-248da32e-71df-4606-85b0-b484d714ac8e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff1a60>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:24.905709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-248da32e-71df-4606-85b0-b484d714ac8e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 345 microversion: 2.1 time: 0.048401 Jan 26 19:26:24.906327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 109/232] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:24 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:24.925944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-288edd82-2e9f-4e3c-81d8-9f4aa37935af tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Action: 'create', calling method: .version_select at 0x7fb7c1041f70>, body: {"snapshot": {"volume_id": "a2683aca-681a-449b-81a6-a09625ecc76a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-226609125"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:24.970732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-58c58b09-c727-4bf5-85c8-07e965684e88 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 26396 microversion: 2.20 time: 0.189541 Jan 26 19:26:24.974797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 124/233] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:24 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 26396 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:24.978708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:24.979406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:24.986140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.986625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:24.987375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:24.987836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:25.084248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-288edd82-2e9f-4e3c-81d8-9f4aa37935af tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.161922 Jan 26 19:26:25.085154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 110/234] 10.222.0.50 () {60 vars in 1161 bytes} [Wed Jan 26 19:26:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:25.096570 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-89ad3a4c-1ff6-4678-be3c-738e009cd064 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c35b5ca0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:25.131097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-89ad3a4c-1ff6-4678-be3c-738e009cd064 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.038352 Jan 26 19:26:25.131831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 111/235] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:25 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:25.137506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:25.141863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b03d256f-d218-4eed-b3b4-f4bb1cb9e9b6 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10a9a60>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:25.145826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dcb0fecb-7ba0-4737-847a-6f50d1241731 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.171690 Jan 26 19:26:25.146630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 125/236] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:24 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:25.179824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b03d256f-d218-4eed-b3b4-f4bb1cb9e9b6 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041507 Jan 26 19:26:25.184913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 112/237] 10.222.0.50 () {58 vars in 1139 bytes} [Wed Jan 26 19:26:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:25.190545 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-95ca7509-dcf5-4607-be46-bd9ea47b940d tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10e6310>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:25.222352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-95ca7509-dcf5-4607-be46-bd9ea47b940d tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.035151 Jan 26 19:26:25.222922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 126/238] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:25 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:25.866423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:25.867467 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:25.873628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:25.874074 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:25.874850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:25.875283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:25.982724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:25.983622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:25.991910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:25.992357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:25.993122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:25.993546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:28.933969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-47a1aa30-d69b-4897-9962-4f481effba70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 27883 microversion: 2.1 time: 3.071512 Jan 26 19:26:28.934639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 113/239] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:25 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 27883 bytes in 3073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:28.939490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:28.940200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:28.946875 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:28.947342 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:28.948146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:28.948579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:28.953818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-264cdaa8-e13d-4d31-a414-0f3290dc3299 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27800 microversion: 2.20 time: 2.974997 Jan 26 19:26:28.957788 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 127/240] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:25 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27800 bytes in 2977 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:28.959273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-28bd9200-a79d-45e8-8faa-262fd0be921b tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c11a49d0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:28.988155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-28bd9200-a79d-45e8-8faa-262fd0be921b tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.032437 Jan 26 19:26:28.988719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 128/241] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:28 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:29.074435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:29.081717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6afc7460-9acf-47a9-b351-d11ec2f48d54 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.146020 Jan 26 19:26:29.082281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 114/242] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:28 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:29.946374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:29.949574 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:29.957001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:29.957582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:29.959519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:29.959519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:29.964709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:29.965860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:29.972387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:29.972827 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:29.973596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:29.974025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:30.041853 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bdb2f3ed-fa9a-46a9-bf41-b6c33756ad5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28053 microversion: 2.1 time: 0.099673 Jan 26 19:26:30.045709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 129/243] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:29 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28053 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:30.047159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-646a45d9-bbe3-4e11-adb6-c0c4854b802c tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10c5a60>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:30.076286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-646a45d9-bbe3-4e11-adb6-c0c4854b802c tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.032565 Jan 26 19:26:30.077147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 130/244] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:30 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:30.079412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8d60fc62-6b49-4b08-a5c0-62beef67b016 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27866 microversion: 2.20 time: 0.118178 Jan 26 19:26:30.080118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 115/245] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:29 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27866 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:30.099202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:30.099948 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:30.106628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:30.107068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:30.107860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:30.108289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:30.235169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:30.242385 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-86f44cf5-0924-4cab-ad0c-7b5f08a292a3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.148063 Jan 26 19:26:30.242935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 131/246] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:30 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:31.053395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:31.054386 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:31.061165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:31.061612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:31.062376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:31.062805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:31.087044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0c55a2f2-698a-4848-80d0-a449f528fac9 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10baca0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:31.115873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0c55a2f2-698a-4848-80d0-a449f528fac9 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.032347 Jan 26 19:26:31.116417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 132/247] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:31 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:31.120855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:31.121799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:31.128326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:31.128767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:31.129524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:31.129951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:32.653645 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24fb00ee-2aac-4f3e-ab8c-96c715e9804e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28053 microversion: 2.1 time: 1.604033 Jan 26 19:26:32.654303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 116/248] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:31 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28053 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:32.659069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:32.659743 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:32.667533 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:32.667989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:32.668751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:32.669176 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:32.791889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:32.799641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d60d2365-ae9a-4d06-b2a0-553371ee295e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.144276 Jan 26 19:26:32.800225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 117/249] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:32 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:32.804339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b75451e8-54f4-4fd8-94f6-47d7404cb88e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c35b5c10>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:32.831611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b75451e8-54f4-4fd8-94f6-47d7404cb88e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.030411 Jan 26 19:26:32.832207 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 118/250] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:32 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:33.666300 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:33.667200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:33.673937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:33.674379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:33.675155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:33.675588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:34.145659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-17cc578b-5fb4-4103-bdf6-868e0929ac5b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27866 microversion: 2.20 time: 3.028007 Jan 26 19:26:34.146942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 133/251] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:31 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27866 bytes in 3029 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:34.151274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:34.151983 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:34.158630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:34.159074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:34.159863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:34.160295 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:34.177511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3de83803-a853-46dc-80e6-734bbfd8e5fe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28053 microversion: 2.1 time: 0.516116 Jan 26 19:26:34.178170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 119/252] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:33 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28053 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:34.183792 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f242376c-1015-4cc1-b7c7-09326b83439a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c1018700>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:34.212319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f242376c-1015-4cc1-b7c7-09326b83439a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.032959 Jan 26 19:26:34.213107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 120/253] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:34 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:34.290474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:34.298647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a02df90-b510-4bb6-aa73-055f59b18688 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.151270 Jan 26 19:26:34.299208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 134/254] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:34 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:35.157597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:35.160808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:35.167423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.167879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.168640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.169060 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.189043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:35.190019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:35.196192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.196641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.197409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.197841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.247831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4d251d9a-ea6f-47e1-a91a-a60e654b47eb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27866 microversion: 2.20 time: 0.094139 Jan 26 19:26:35.248489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 121/255] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:35 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27866 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:35.253253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-95fbdec8-d097-4c8a-9bed-2cbecbadf44e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff6d30>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:35.281859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-95fbdec8-d097-4c8a-9bed-2cbecbadf44e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 287 microversion: 2.1 time: 0.032127 Jan 26 19:26:35.282442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 122/256] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:35 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:35.292380 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7abaffad-3340-4a67-ad70-49d9e6b8c55e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff64c0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:35.293207 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e839c47f-f774-42bb-93ae-f03fa308f55e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28053 microversion: 2.1 time: 0.107620 Jan 26 19:26:35.293839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 135/257] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:35 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28053 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:35.316454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:35.317149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:35.324114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.324561 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.325329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:35.325759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:35.352207 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7abaffad-3340-4a67-ad70-49d9e6b8c55e tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 202 len: 0 microversion: 2.1 time: 0.063657 Jan 26 19:26:35.358598 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 123/258] 10.222.0.50 () {58 vars in 1253 bytes} [Wed Jan 26 19:26:35 2022] DELETE /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:35.366038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cdb79ea7-1ec2-413a-8855-95ad954a325f tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff1670>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:35.393769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cdb79ea7-1ec2-413a-8855-95ad954a325f tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.031036 Jan 26 19:26:35.394470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 124/259] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:35 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:35.459346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:35.467594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-87820c80-cdb9-4e69-a17f-d940a8f85bc3 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.155039 Jan 26 19:26:35.468174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 136/260] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:35 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:36.259870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:36.260921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:36.267034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:36.267472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:36.268272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:36.268703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:36.304554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:36.305488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:36.312430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:36.312874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:36.313640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:36.314074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:39.405592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7f5c14a1-cc89-423b-b170-54e7cdc8fc01 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27882 microversion: 2.20 time: 3.149771 Jan 26 19:26:39.406266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 125/261] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:36 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27882 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:39.410924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a87d783a-e395-45a6-ad34-2950effc03c1 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff6820>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:39.432329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0c3bd788-1eb6-444d-bbd7-4f9fdd7d5db8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 3.131223 Jan 26 19:26:39.436143 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 137/262] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:36 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 3133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:39.438418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:39.439009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a87d783a-e395-45a6-ad34-2950effc03c1 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.031554 Jan 26 19:26:39.439121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:39.439574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 126/263] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:39 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:39.446167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:39.446610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:39.447930 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:39.448359 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:39.577646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:39.585505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7bf8253c-3d05-4733-8e1b-0eb1faccdd59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.151169 Jan 26 19:26:39.586107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 138/264] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:39 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:40.418134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:40.419155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:40.425215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.425680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.426440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.426870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.443653 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:40.444649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:40.451244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.451691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.452515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.452952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.543731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5d5557e8-c37f-40cc-a9fc-73e8f0e608e8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 27993 microversion: 2.20 time: 0.130056 Jan 26 19:26:40.547468 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 127/265] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:40 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 27993 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:40.549152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-70dc0ccd-96dc-4b07-a04d-034180b4d394 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c1066ca0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:40.558764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8da81a43-8ccb-492b-8a9b-1186f706a938 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.118648 Jan 26 19:26:40.560037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 139/266] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:40 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:40.577419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-70dc0ccd-96dc-4b07-a04d-034180b4d394 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 200 len: 286 microversion: 2.1 time: 0.031801 Jan 26 19:26:40.577938 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 128/267] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:40 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:26:40.601698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:40.602387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:40.610624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.611077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.611881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:40.612321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:40.748914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:40.756098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a27651b8-0b47-46cd-9f92-2f0b23339faa tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.158318 Jan 26 19:26:40.756665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 140/268] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:40 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:41.557199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:41.559680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:41.567267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.567712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.568671 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.569107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.579473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:41.581829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:41.594535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.595290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.597722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.598289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.656138 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3ebe8b14-d1fe-4ce2-88ed-fdd47eee2406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28111 microversion: 2.20 time: 0.103836 Jan 26 19:26:41.656811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 129/269] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:41 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28111 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:26:41.662266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-68a7f724-85a6-4d1d-b08d-602635abd099 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10b49d0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:41.686382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1c7249f2-43dd-4ef4-b149-c0c3b2b18494 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.114825 Jan 26 19:26:41.686382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 141/270] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:41 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:41.687411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-68a7f724-85a6-4d1d-b08d-602635abd099 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] HTTP exception thrown: Snapshot 84d39e22-ebb5-4164-8842-e937b73275f7 could not be found. Jan 26 19:26:41.688124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-68a7f724-85a6-4d1d-b08d-602635abd099 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Returning 404 to user: Snapshot 84d39e22-ebb5-4164-8842-e937b73275f7 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:41.688955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-68a7f724-85a6-4d1d-b08d-602635abd099 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7" status: 404 len: 111 microversion: 2.1 time: 0.030420 Jan 26 19:26:41.689528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 130/271] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Jan 26 19:26:41 2022] GET /compute/v2.1/os-snapshots/84d39e22-ebb5-4164-8842-e937b73275f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:41.698222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fdfef8da-6f87-479f-8b3e-be9d74aca1ca tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c107e310>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:41.760091 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fdfef8da-6f87-479f-8b3e-be9d74aca1ca tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 202 len: 0 microversion: 2.1 time: 0.065917 Jan 26 19:26:41.760776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 142/272] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:26:41 2022] DELETE /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:41.770082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-28e8520c-60b4-4793-80ac-73c0f30ca6ea tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c35b51f0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:41.774088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:41.777357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:41.784444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.784883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.785669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:41.786105 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:41.855516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-28e8520c-60b4-4793-80ac-73c0f30ca6ea tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 200 len: 344 microversion: 2.1 time: 0.090363 Jan 26 19:26:41.856114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 131/273] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:41 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:26:41.934219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:41.941701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-18d6a2b3-f747-4c3c-8eed-ec30be64b996 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.172241 Jan 26 19:26:41.942266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 143/274] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:41 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:26:42.669753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:42.671655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:42.678288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.678912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:42.679688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.680153 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:42.697137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:42.698683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:42.705839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.706297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:42.707081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.707683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:42.764864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-74d69e42-4f6b-4745-8896-bf98046eeb0d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.100409 Jan 26 19:26:42.765572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 132/275] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:42 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:42.800562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d68ffc58-bc46-4c7c-9a30-0ab0591b98be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.107040 Jan 26 19:26:42.801352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 144/276] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:42 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:42.869965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72d809be-9d47-4b27-909b-08518d82a430 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c0ff6790>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:42.921999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-72d809be-9d47-4b27-909b-08518d82a430 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] HTTP exception thrown: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. Jan 26 19:26:42.925799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72d809be-9d47-4b27-909b-08518d82a430 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Returning 404 to user: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:42.926758 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72d809be-9d47-4b27-909b-08518d82a430 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 404 len: 109 microversion: 2.1 time: 0.061984 Jan 26 19:26:42.927397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 133/277] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:42 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:42.942527 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e6314b87-3e92-4ec6-a951-c8225f975119 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c10c5af0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:42.969821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:42.970565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:42.981197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.981829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:42.983069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:42.983687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:43.203765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-e6314b87-3e92-4ec6-a951-c8225f975119 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] HTTP exception thrown: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. Jan 26 19:26:43.204488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e6314b87-3e92-4ec6-a951-c8225f975119 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Returning 404 to user: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:43.205806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e6314b87-3e92-4ec6-a951-c8225f975119 tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 404 len: 109 microversion: 2.1 time: 0.267809 Jan 26 19:26:43.207359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:43.209693 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 145/278] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:26:42 2022] DELETE /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 109 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:43.217022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-02451cb3-0916-45e4-a8cb-f2403d9bb46a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Calling method '.version_select at 0x7fb7c11a4670>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:43.218593 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-daaee78d-3fca-4b8c-8e28-9f2de317586b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.263548 Jan 26 19:26:43.219868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 134/279] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:42 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:43.314927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-02451cb3-0916-45e4-a8cb-f2403d9bb46a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] HTTP exception thrown: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. Jan 26 19:26:43.316324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-02451cb3-0916-45e4-a8cb-f2403d9bb46a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] Returning 404 to user: Volume a2683aca-681a-449b-81a6-a09625ecc76a could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:26:43.318030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-02451cb3-0916-45e4-a8cb-f2403d9bb46a tempest-VolumesSnapshotsTestJSON-294575891 tempest-VolumesSnapshotsTestJSON-294575891-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a" status: 404 len: 109 microversion: 2.1 time: 0.107050 Jan 26 19:26:43.318913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 146/280] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:26:43 2022] GET /compute/v2.1/os-volumes/a2683aca-681a-449b-81a6-a09625ecc76a => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:26:43.779715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:43.780664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:43.787205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:43.787906 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:43.788577 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:43.789009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:43.814301 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:43.816511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:43.825809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:43.826572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:43.827756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:43.828655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:43.859484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-459fe2e7-51e0-4288-b305-e7785ee555cd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.084594 Jan 26 19:26:43.860694 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 135/281] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:43 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:43.908860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-872ecb10-af0a-47b2-84e0-047bd73e0eb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.100044 Jan 26 19:26:43.909897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 147/282] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:43 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:44.236243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:44.237258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:44.244624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.245278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:44.246246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.247056 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:44.428169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:44.437730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac291853-94be-49e5-b6ba-c56438d9dbc8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.205873 Jan 26 19:26:44.438397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 136/283] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:44 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:44.873925 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:44.876910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:44.886533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.887696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:44.888775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.889537 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:44.921642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:44.923439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:44.931850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.932622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:44.933559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:44.934154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:45.255815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6c17869b-efa6-4426-bd75-a0ac26e6fcee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.385281 Jan 26 19:26:45.255815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 148/284] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:44 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:45.264837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f4315a44-1fc4-4c94-8421-f6818c8d5e8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.347326 Jan 26 19:26:45.266620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 137/285] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:44 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:45.456129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:45.456908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:45.466409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:45.471368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:45.472263 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:45.472783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:45.640834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:45.649299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3cfe6dc3-478c-4038-bd5c-6cc8a3b13fcc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.196596 Jan 26 19:26:45.659253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 149/286] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:45 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:46.266213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:46.267202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:46.275193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:46.275641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:46.276454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:46.276888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:46.277008 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:46.277962 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:46.284417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:46.285138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:46.286140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:46.286773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:48.866031 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-12b72e0c-21cf-46e1-9006-b1b063a46b64 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 2.603718 Jan 26 19:26:48.871859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 138/287] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:46 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:48.872178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:48.872737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:48.879568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:48.880046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:48.880816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:48.881358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:48.891387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bfcb0da1-3250-4fa9-9dab-0a520e53de51 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 2.616735 Jan 26 19:26:48.897617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 150/288] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:46 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:49.082420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:49.095988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f45c285-fde7-4f9d-841c-98651c18e134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.228075 Jan 26 19:26:49.097394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 139/289] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:48 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:49.886379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:49.890160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:49.904489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:49.905398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:49.909699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:49.911333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:49.916168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:49.916726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:49.917948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:49.919672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:49.920669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:49.922306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:50.025347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-87b8942c-992a-4068-8ca3-1438caf9596e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.147905 Jan 26 19:26:50.026771 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 151/290] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:49 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:50.041913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c2c60041-b76f-4b21-8080-24c2e6a5c3ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.140810 Jan 26 19:26:50.042570 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 140/291] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:49 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:50.117071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:50.127887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:50.139036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:50.139886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:50.141773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:50.142219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:50.307436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:50.315342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0131a7f8-f0dc-43ad-9373-8e928413d14b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.203530 Jan 26 19:26:50.315951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 152/292] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:50 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:51.039161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:51.040362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:51.053517 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.055070 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.056743 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.057432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.057723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:51.059079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:51.067403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.068020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.069026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.069467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.463528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b216e560-7b14-45d7-86d1-ab8ae3f0cd28 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.429227 Jan 26 19:26:51.464819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 141/293] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:51 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:51.467716 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a8932c70-a7e9-4dd9-baca-10c50c608102 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.417638 Jan 26 19:26:51.468916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 153/294] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:51 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:51.470297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:51.476812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:51.485619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.491205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.492117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:51.492563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:51.694069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:51.713164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-13b0c091-306c-43de-9c82-f9c100242c0a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1521 microversion: 2.1 time: 0.247006 Jan 26 19:26:51.713742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 142/295] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:51 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:52.475368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:52.476462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:52.478505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:52.479415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:52.484314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.484762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.485533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.485745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.485960 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.486196 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.486978 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.487411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.559944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-472b5412-178c-40c9-9699-364b3242e58c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.088760 Jan 26 19:26:52.560851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 154/296] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:52 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:52.575365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d1e07dea-e307-40d6-9008-c94c2522776d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.100561 Jan 26 19:26:52.576040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 143/297] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:52 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:52.732171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:52.732899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:52.740587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.741148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.742112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.742543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.923292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:52.933137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-aaab2dac-241a-4595-b016-e8b2fb21b349 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1501 microversion: 2.1 time: 0.204363 Jan 26 19:26:52.934450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 155/298] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:52 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:52.959676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:52.960443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:52.969930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.970447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:52.971326 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:52.971864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:53.150838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:53.158724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c9c77721-4782-4631-a237-526369eebf38 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1516 microversion: 2.1 time: 0.208338 Jan 26 19:26:53.159349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 144/299] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:52 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:53.572364 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:53.573356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:53.579596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:53.580162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:53.581061 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:53.581589 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:53.586602 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:53.588650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:53.594900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:53.595347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:53.596155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:53.596822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:53.812310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cd022753-c981-43dd-bcb2-217a7a63dc74 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.243996 Jan 26 19:26:53.813293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 156/300] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:53 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:53.832214 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8b59977d-9a26-47b1-8ed9-96f3b892a0dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.249113 Jan 26 19:26:53.836057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 145/301] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:53 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:26:54.824615 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:54.826268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:54.833423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:54.833937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:54.834879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:54.835515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:54.845335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:54.847471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:54.856114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:54.856798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:54.857785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:54.858288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:57.707035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-90cf6e79-31b7-491e-ada0-8a1fdbd87eed tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 2.886392 Jan 26 19:26:57.711004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 157/302] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:54 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:57.714012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-570642f1-a38e-4040-8b72-98a2657d97ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 2.874047 Jan 26 19:26:57.714649 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 146/303] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:54 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:58.718914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:58.719974 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:58.726351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:58.727852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:58.728120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.728570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.729421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.729858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.735174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.735611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.736406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.736883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.794050 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-39db3dd9-fb84-43ec-88ec-1a865fc5508a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.079047 Jan 26 19:26:58.794697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 158/304] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:58 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:26:58.799675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-75b97014-5edb-4052-8640-c3fe91b714d0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.077259 Jan 26 19:26:58.800333 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 147/305] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:58 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:26:58.882899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:58.884337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:58.891222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.891661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.892458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:58.893035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:58.918924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lazy-loading 'flavor' on Instance uuid d757f9bf-0099-40a5-aa9d-9c174a3ac859 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:26:59.028658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b38bfa90-c016-4fa4-a873-b43e85b94918 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action" status: 200 len: 32 microversion: 2.1 time: 0.150006 Jan 26 19:26:59.029253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 159/306] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:58 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:26:59.038641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:26:59.039518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:59.048931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.049497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:59.050537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.050995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:59.255505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:26:59.263211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0866ab10-f9b9-4ef1-b7a8-eaa6dc2112f9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.228516 Jan 26 19:26:59.264101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 148/307] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:26:59 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:26:59.807160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:59.808158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:59.810573 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:26:59.811460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:26:59.814430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.814871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:59.815641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.816120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:59.817523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.817969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:26:59.818738 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:26:59.819173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:03.142874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6d1d1047-9b58-42d4-a0f5-72f3b152c65e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 3.340500 Jan 26 19:27:03.143509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 160/308] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:26:59 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 3342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:03.148174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:03.149730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:03.153876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0ad5850c-d416-41af-98f0-e3df0f7aacf8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 3.346705 Jan 26 19:27:03.154532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 149/309] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:26:59 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:03.156575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:03.157018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:03.157786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:03.158214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:03.300190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:03.307244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8f9c1acb-3155-4ea4-bbf6-d943468c18ed tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.162601 Jan 26 19:27:03.307850 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 161/310] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:03 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:04.155066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:04.156089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:04.162960 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.163461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.164281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.165194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.166618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:04.167909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:04.176191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.176191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.176191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.176465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.229728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-365e532a-e7d5-480a-9f85-c8c963c77061 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.078498 Jan 26 19:27:04.230392 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 150/311] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:04 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:04.240996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7fe9419b-f6d6-40f5-99c4-a5d01b3b37b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.079084 Jan 26 19:27:04.241618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 162/312] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:04 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:04.324334 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:04.325024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:04.331758 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.332238 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.333007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:04.333436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:04.462641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:04.471632 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9e956d33-77e9-4af4-a071-c37c8ebf5505 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.151008 Jan 26 19:27:04.472553 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 151/313] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:04 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:05.242654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:05.244252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:05.251360 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.251856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.252636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.253072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.253171 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:05.254374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:05.261348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.262010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.262788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.263217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.327992 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c3213732-91cb-4e46-b48d-4d7329df69ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.089601 Jan 26 19:27:05.328833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 163/314] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:05 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:05.333557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2015270765", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "ca72cad8-294c-4f10-8a99-4392c0b5b4f2"}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:05.336053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-665ce9de-64b2-4037-a976-72f3237da7cd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.086335 Jan 26 19:27:05.336687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 152/315] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:05 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:05.384109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] validate_networks() for [('ca72cad8-294c-4f10-8a99-4392c0b5b4f2', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:27:05.491523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:05.492248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:05.499789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.500252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.501028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.501461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.655257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:05.665081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-33357d77-e9f1-4b5a-8aa8-27cefd0bec90 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.177884 Jan 26 19:27:05.666131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 153/316] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:05 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:05.750168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:27:05.750573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:27:05.751034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:27:05.751598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:27:05.752057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:27:05.761481 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.761990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.762792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:05.763220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:05.781598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Getting quotas for project 48cdb224373e4cbca601532981d8f3dc. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:27:05.792469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Getting quotas for user 5640eee1eddd4162a0641516206b7bde and project 48cdb224373e4cbca601532981d8f3dc. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:27:05.807150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:27:05.809744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:27:05.857654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a72d6fea-3799-4c25-9962-1c51bc832dce tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527679 Jan 26 19:27:05.858596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 164/317] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:27:05.869474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b440e0b7-9b2a-47ca-9c35-64d16a8c212e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:05.870082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b440e0b7-9b2a-47ca-9c35-64d16a8c212e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:05.926320 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b440e0b7-9b2a-47ca-9c35-64d16a8c212e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:05.933450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b440e0b7-9b2a-47ca-9c35-64d16a8c212e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1214 microversion: 2.1 time: 0.068145 Jan 26 19:27:05.934020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 154/318] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:05 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:06.341434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:06.342840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:06.350418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:06.352577 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:06.360805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.361254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.361588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.362031 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.362135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.362462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.362898 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.363337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.460132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-da1a3329-6ad9-48f5-9728-ed514ab530ae tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.116114 Jan 26 19:27:06.464524 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 155/319] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:06 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:06.465607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-73198669-4202-4d46-bac0-964e9ffe8031 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.129564 Jan 26 19:27:06.466515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 165/320] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:06 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:06.682645 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:06.683332 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:06.690400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.690927 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.691806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.692470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.819165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:06.828847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-33676e1f-b907-44c9-9777-cb9874f9ad09 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.150655 Jan 26 19:27:06.829499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 156/321] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:06 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:06.951286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:06.951662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:06.958661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.959304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:06.960358 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:06.960884 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:07.026158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:07.033313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a8c76360-3fd8-4be1-bc21-cc4fd30a3bb1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1266 microversion: 2.1 time: 0.086611 Jan 26 19:27:07.033874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 166/322] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:06 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:07.472143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:07.473052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:07.477799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:07.478691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:07.479961 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:07.480411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:07.481218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:07.481650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:07.484840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:07.485359 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:07.486128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:07.486556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:10.588425 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fdc54ef7-b892-43b0-bd0b-926573f793a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 3.119700 Jan 26 19:27:10.589022 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 157/323] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:07 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 3121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:10.593741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:10.594415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:10.601224 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:10.601666 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:10.602856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1e73aa2a-c872-4b22-8cbc-277eaebff59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 3.128677 Jan 26 19:27:10.603307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:10.603473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:10.604062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 167/324] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:07 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:10.609447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:10.609713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:10.616634 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:10.617086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:10.617902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:10.618341 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:10.680504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:10.688242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c135098f-c2db-414f-b86c-05901361dd0d tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1266 microversion: 2.1 time: 0.082977 Jan 26 19:27:10.688804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 168/325] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:10 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:10.813999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:10.822213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ea51b1df-75d1-4fc3-9e5f-cfbaa3252ab0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.232063 Jan 26 19:27:10.822789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 158/326] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:10 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:11.599872 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:11.601150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:11.608043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.608636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.609265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.609696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.614043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:11.615085 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:11.621824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.622385 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.623295 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.623919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.681602 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-412094b5-4ca9-4125-83b7-c342faef0671 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.085272 Jan 26 19:27:11.685524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 169/327] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:11 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:11.688413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7516cf53-1650-4366-9b2d-8dcf83e12648 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.077754 Jan 26 19:27:11.692234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 159/328] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:11 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:11.705339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:11.706180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:11.712990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.713442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.714220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.714657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.839475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:11.840400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:11.848036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:11.850530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.850968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.851745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:11.852871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:11.864045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1cf05f3d-2310-43fc-b8c8-dccfa3242970 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.162525 Jan 26 19:27:11.864735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 170/329] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:11 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:12.085330 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:12.093230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-46b90d61-bf4a-4970-966c-085cd47bb69e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.258502 Jan 26 19:27:12.094071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 160/330] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:11 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:12.327223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-4a14ed2e-fdc5-49e4-b89a-2351c80d53ab req-bc292c86-c260-4d05-be16-b6e2c9b99ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2c2597-b7d6-4019-9a8c-918a6e84c5ee", "tag": "0d593cd6-8871-48fa-9a6b-f26cef3519ce"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:12.329205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:27:12.329205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:27:12.338082 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-4a14ed2e-fdc5-49e4-b89a-2351c80d53ab req-bc292c86-c260-4d05-be16-b6e2c9b99ae6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.339349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-4a14ed2e-fdc5-49e4-b89a-2351c80d53ab req-bc292c86-c260-4d05-be16-b6e2c9b99ae6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.352701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-4a14ed2e-fdc5-49e4-b89a-2351c80d53ab req-bc292c86-c260-4d05-be16-b6e2c9b99ae6 service nova] Creating event network-changed:0d593cd6-8871-48fa-9a6b-f26cef3519ce for instance fa2c2597-b7d6-4019-9a8c-918a6e84c5ee on hv-cinder-79400 Jan 26 19:27:12.358100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-4a14ed2e-fdc5-49e4-b89a-2351c80d53ab req-bc292c86-c260-4d05-be16-b6e2c9b99ae6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034897 Jan 26 19:27:12.360277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 171/331] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:27:12.695601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:12.697324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:12.703940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:12.704507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.704683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.705466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:12.705631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.706153 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.712916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.713497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.714436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.715118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.802978 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-259ffd72-f031-4ffd-99ae-0e5334a96327 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.113184 Jan 26 19:27:12.803612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 161/332] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:12 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:12.808762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f31742dc-3734-4eb5-b4b6-9a074ce5d022 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.111544 Jan 26 19:27:12.809401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 172/333] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:12 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:12.881985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:12.882750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:12.890198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.890647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:12.891415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:12.891865 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.100401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:13.108562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-60e19cfd-9dae-445f-8dba-231468d48b46 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.230568 Jan 26 19:27:13.109135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 162/334] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:12 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:13.111206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:13.111926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:13.119075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.119520 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.120321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.120751 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.253214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:13.260932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-538f7f19-b6ee-4fe0-86f9-5b75934edccc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.154115 Jan 26 19:27:13.261843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 173/335] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:13 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:13.814509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:13.815591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:13.822042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:13.822542 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.822812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.823639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.823999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:13.824239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.831259 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.831697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:13.832493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:13.833055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:14.013377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3e1c3db0-2244-4a65-ba16-63f6e57b0027 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.202407 Jan 26 19:27:14.014811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 163/336] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:13 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:14.016234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bb24e430-d44c-4638-8a8b-060df6e67a5c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.198734 Jan 26 19:27:14.016879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 174/337] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:13 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:14.125946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:14.126664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:14.134076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:14.134520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:14.135296 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:14.135729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:14.268240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:14.275701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a45dc378-1fcb-4d72-85cb-95484f310b9c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.153698 Jan 26 19:27:14.276397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 164/338] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:14 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:14.279480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:14.280225 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:14.287051 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:14.287505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:14.288309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:14.288779 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:14.417270 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:14.424934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-95a6d276-01fa-4220-9501-1f5195edde53 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.149736 Jan 26 19:27:14.425506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 175/339] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:14 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:15.025733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:15.026602 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:15.027460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:15.028421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:15.033135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:15.033589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:15.034416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:15.034594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:15.034869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:15.035038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:15.035851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:15.036332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:19.244408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2dcb6db4-a057-48ce-a03a-312e808de946 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 4.220971 Jan 26 19:27:19.245871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 176/340] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:15 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 4223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:19.252977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:19.253768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:19.260976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:19.261543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:19.262150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-15783a01-7704-43b3-8531-fc270e7e6263 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 4.240484 Jan 26 19:27:19.262608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:19.262884 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:19.266307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 165/341] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:15 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 4246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:19.271953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:19.272639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:19.280247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:19.280486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:19.281421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:19.281738 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:19.402950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:19.410286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-35f82d10-e726-4347-82dd-f7a06e338c6c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.163045 Jan 26 19:27:19.410940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 177/342] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:19 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:19.418234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:19.425589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8103a22e-fc8c-445b-9869-903ec2ccf4f0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.158141 Jan 26 19:27:19.426136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 166/343] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:19 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:20.257078 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:20.258583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:20.264835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.265277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.266032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.266456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.274146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:20.275110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:20.281378 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.281817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.282592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.283015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.336549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f7998dcb-0492-497d-b18d-592630843044 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.083039 Jan 26 19:27:20.337183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 178/344] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:20 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:20.344451 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c742874b-9332-4fff-9f75-cd726070db18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.074006 Jan 26 19:27:20.345283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 167/345] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:20 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:20.428052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:20.428736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:20.436176 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.436620 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.437380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.437810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.442685 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:20.443374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:20.450336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.450781 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.451565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:20.452015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:20.564750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:20.573216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3bd8f12e-e8db-4a06-8b58-aeb15dfdb5e7 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.149047 Jan 26 19:27:20.573788 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 179/346] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:20 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:20.578260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:20.585875 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-123e9f9c-710a-4367-a6e3-6cb5c50ac58e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.147144 Jan 26 19:27:20.586417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 168/347] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:20 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:21.348209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:21.349236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:21.355540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.355696 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:21.356132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.356503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:21.356778 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.357207 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.362439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.362892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.363700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.364150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.806729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-372a6c51-6f1e-4bdd-a3ab-71516fd3cfa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.462035 Jan 26 19:27:21.807383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 180/348] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:21 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:21.807965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d78c3479-d353-4318-841b-97bbe99d1174 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.455791 Jan 26 19:27:21.812263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 169/349] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:21 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:21.812739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:21.813431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:21.817640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:21.818329 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:21.821121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.821572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.822344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.822769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.826684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.827180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.827994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:21.828433 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:21.951580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:21.953466 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:21.959432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6e206494-e14e-4da5-b375-d08102083c5e tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.150490 Jan 26 19:27:21.960057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 181/350] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:21 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:21.961046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-542492e5-cead-49ac-bf20-ec04d03cc4fd tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.147394 Jan 26 19:27:21.961669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 170/351] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:21 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:22.818369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:22.819284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:22.819406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:22.820808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:22.826139 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:22.826590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:22.826940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:22.827360 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:22.827468 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:22.827808 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:22.828172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:22.828605 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:25.396740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-048eb197-812f-47a1-b359-6fcca396583a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 2.581871 Jan 26 19:27:25.398094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 182/352] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:22 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 2583 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:25.402670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:25.403443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:25.407198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f687635f-578b-4f6d-8577-2c6141041a88 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 2.591282 Jan 26 19:27:25.408713 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 171/353] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:22 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:25.409960 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:25.410411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:25.411191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:25.411622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:25.412573 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:25.413293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:25.421815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:25.422407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:25.423254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:25.423749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:25.554321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:25.561883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8245de6e-2233-41ca-805c-2b9c398463b3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.163390 Jan 26 19:27:25.562537 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 183/354] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:25 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:25.587457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:25.594717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a0163430-e63e-4c09-9bb6-965966303230 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.185774 Jan 26 19:27:25.595251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 172/355] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:25 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:26.408783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:26.409922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:26.417089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.417626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.418423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.418681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:26.419107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.419590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:26.425814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.426258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.427030 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.427455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.553923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-48aa5ec0-e266-432f-a6b4-5eedd52fb517 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.138716 Jan 26 19:27:26.556074 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 173/356] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:26 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:26.559076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-85330588-fe09-4728-bca9-47020c17eb48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.153754 Jan 26 19:27:26.560531 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 184/357] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:26 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:26.578930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:26.579621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:26.586380 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.586828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.587608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.588063 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.612413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:26.613108 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:26.620887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.621585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.622374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:26.622814 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:26.720452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:26.728229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d2948100-9dc6-4f2b-9057-3c6372c63eb3 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.153251 Jan 26 19:27:26.728726 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 174/358] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:26 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:26.755211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:26.762767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ce56fc68-3470-4783-829b-6ca9ddeeed79 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.154449 Jan 26 19:27:26.763319 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 185/359] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:26 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:27.566189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:27.567109 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:27.573654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:27.574741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:27.575313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.575970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.577531 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.578125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.584010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.584632 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.585424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.585900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.655810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-84058957-d648-402d-b87a-1fa00730d163 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.092832 Jan 26 19:27:27.656758 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 175/360] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:27 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:27.663028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-67a738f2-9861-4c64-a8f6-67be47f9c337 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.094558 Jan 26 19:27:27.667224 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 186/361] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:27 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:27.747518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:27.748985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:27.757201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.758477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.759437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.760048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.779901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:27.780676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:27.791863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.792563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.795142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:27.795655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:27.909391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:27.921082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b1fb5c9-0984-4351-be4a-462ddf06fdd9 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.177593 Jan 26 19:27:27.930941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 176/362] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:27 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:27.943705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:27.951477 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8a68445f-b85b-4a58-9be4-bc25ef7f1c9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.176671 Jan 26 19:27:27.952070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 187/363] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:27 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:28.669084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:28.669919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:28.674173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:28.675120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:28.676196 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:28.676646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:28.677420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:28.677852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:28.682007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:28.682455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:28.683231 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:28.683669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.168166 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1c7b487e-a3a7-4244-9a39-9a17a1e2d15f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 3.497435 Jan 26 19:27:32.168845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 188/364] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:28 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 3499 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:32.173491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:32.174164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:32.181354 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:32.181795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.182559 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:32.182984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.183537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e07766e1-45f4-4854-9d31-bb4d4704beb3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 3.518056 Jan 26 19:27:32.185156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 177/365] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:28 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 3520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:32.189036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:32.189716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:32.197110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:32.197556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.198544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:32.198779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.320711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:32.328142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e37698ce-6cdd-48b4-8a6e-3cd0e284831c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.158213 Jan 26 19:27:32.328706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 189/366] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:32 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:32.333020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-3ad0de4a-f7fd-4614-8a1b-469ccaee47b6 req-c63396eb-0f1e-4157-9007-f41b06f5a796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2c2597-b7d6-4019-9a8c-918a6e84c5ee", "name": "network-vif-plugged", "status": "completed", "tag": "0d593cd6-8871-48fa-9a6b-f26cef3519ce"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:32.334597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:27:32.334597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:27:32.341179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-3ad0de4a-f7fd-4614-8a1b-469ccaee47b6 req-c63396eb-0f1e-4157-9007-f41b06f5a796 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:32.341622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-3ad0de4a-f7fd-4614-8a1b-469ccaee47b6 req-c63396eb-0f1e-4157-9007-f41b06f5a796 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:32.349150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:32.355278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-3ad0de4a-f7fd-4614-8a1b-469ccaee47b6 req-c63396eb-0f1e-4157-9007-f41b06f5a796 service nova] Creating event network-vif-plugged:0d593cd6-8871-48fa-9a6b-f26cef3519ce for instance fa2c2597-b7d6-4019-9a8c-918a6e84c5ee on hv-cinder-79400 Jan 26 19:27:32.358967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-39333411-09d9-405f-b896-abe8d4e6dc43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.171391 Jan 26 19:27:32.359196 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 178/367] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:32 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:32.360371 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-3ad0de4a-f7fd-4614-8a1b-469ccaee47b6 req-c63396eb-0f1e-4157-9007-f41b06f5a796 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030422 Jan 26 19:27:32.360955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 190/368] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:27:33.179442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:33.180393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.186522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.187072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.187717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.188183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.195571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:33.196607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.202519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.202966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.203765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.204255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.386680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f96b3d6d-e83d-4faa-a416-f8527909a116 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.210705 Jan 26 19:27:33.387552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 179/369] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:33 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:33.390676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8a91a6dc-7efd-492f-968e-0edd7633ef55 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.199676 Jan 26 19:27:33.394292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 191/370] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:33 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:33.394440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:33.394440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.396222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:33.396900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.400193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.400643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.401422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.401854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.404302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.404748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.405508 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.405940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.526884 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:33.531219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:33.534588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ceb4f677-e2b3-45eb-ad79-535d0ef854bb tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.146123 Jan 26 19:27:33.535160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 180/371] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:33 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:33.538493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b64a0b79-ffdc-40ba-9e0b-2f6b8febc02f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1502 microversion: 2.1 time: 0.145860 Jan 26 19:27:33.539093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 192/372] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:33 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1502 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:33.554266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3cb9857-fb48-4f66-99b1-55cadf895654"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:33.555870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.561695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.562140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.562908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.563343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.586233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] HTTP exception thrown: Cannot 'attach_volume' instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 while it is in vm_state rescued Jan 26 19:27:33.587259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Returning 409 to user: Cannot 'attach_volume' instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 while it is in vm_state rescued {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:27:33.588791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f421f14b-dabf-438b-9ce1-15364a6856cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038227 Jan 26 19:27:33.590293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 181/373] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:27:33 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 26 19:27:33.598417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:33.599011 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.606471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.606921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.607708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.608169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.681886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-edb20de5-c5b6-4a85-aa7b-14579a4d4ac1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action" status: 202 len: 0 microversion: 2.1 time: 0.087081 Jan 26 19:27:33.685427 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 193/374] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:33 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:33.691627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:33.692477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:33.700901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.701503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.703069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:33.703513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:33.920235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:33.927745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bc78468f-0754-4303-8c01-0479924fb134 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1510 microversion: 2.1 time: 0.239985 Jan 26 19:27:33.928340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 182/375] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:33 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:34.400024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:34.401017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:34.401869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:34.402789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:34.407088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.407539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.408342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.408774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.409086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.409542 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.410322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.410762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.497922 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8336505-bde1-4829-b184-574f7eb9d023 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28170 microversion: 2.1 time: 0.100189 Jan 26 19:27:34.498461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 183/376] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:34 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28170 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:34.527262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e3681dd1-21ef-4b7d-9eea-c101ea53fb55 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.132503 Jan 26 19:27:34.527919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 194/377] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:34 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:34.551284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:34.552254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:34.559234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.559680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.560478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.560909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.692850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:34.701009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c6d4cd6a-6c36-40ff-b366-116ef334dccf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1314 microversion: 2.1 time: 0.154242 Jan 26 19:27:34.701557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 184/378] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:34 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:34.949226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:34.949992 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:34.956959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.957591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:34.958367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:34.958828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.089594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:35.097491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b08be326-8a6b-40ef-b950-0dd8aa30e86f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1510 microversion: 2.1 time: 0.155685 Jan 26 19:27:35.098124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 195/379] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:34 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:35.509525 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:35.510436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:35.516829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.517277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.518245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.518681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.538483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:35.540075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:35.546583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.547046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.548069 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.548566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.653831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a9489835-1e86-4776-a01e-833ac2277592 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28460 microversion: 2.1 time: 0.147858 Jan 26 19:27:35.657942 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 185/380] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:35 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28460 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:35.660551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-167bc160-e2a1-4fa1-8d3f-8e5448a9cf2f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28228 microversion: 2.20 time: 0.125645 Jan 26 19:27:35.661197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 196/381] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:35 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28228 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:35.718068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:35.718794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:35.725798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.726820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.727675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:35.728143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:35.857801 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:35.865511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4effab0f-b810-48f9-a4fd-539792b7afe5 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1498 microversion: 2.1 time: 0.151616 Jan 26 19:27:35.866066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 186/382] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:35 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:36.114782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:36.115649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:36.122617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.123071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.123880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.124318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.237099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:36.237855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:36.244344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.244794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.245569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.246169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.264156 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:36.273349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4462c5a5-b164-4678-81cd-3c9939b9b512 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1510 microversion: 2.1 time: 0.162632 Jan 26 19:27:36.279555 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:27:36.285223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 197/383] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:36 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:36.376224 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4c6bcb01-4159-4d9e-8990-843eb1203cd8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 204 len: 0 microversion: 2.1 time: 0.142731 Jan 26 19:27:36.376819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 187/384] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:27:36 2022] DELETE /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:27:36.385330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:36.385931 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:36.392658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.393106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.393882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.394303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.527137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:36.534846 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0d7810a9-1dff-4d53-aae4-845b4e88f4b2 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1504 microversion: 2.1 time: 0.153657 Jan 26 19:27:36.535393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 198/385] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:36 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:36.665909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:36.666975 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:36.672859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:36.673505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.673944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:36.674077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.674718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.675149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.683169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.683699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.684622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:36.685113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:36.837711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-920fb9ca-e6d3-4453-9684-3549cc8cf860 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28516 microversion: 2.20 time: 0.168386 Jan 26 19:27:36.838372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 199/386] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:36 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:36.843298 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c5b587f2-c283-44d9-958c-e38b698f897e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28460 microversion: 2.1 time: 0.181159 Jan 26 19:27:36.844195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 188/387] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:36 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28460 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:37.291278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:37.291995 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:37.298768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.299212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.300027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.300470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.479732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:37.490777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fc111679-68f1-4675-a683-8c59c63fcc59 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1510 microversion: 2.1 time: 0.204005 Jan 26 19:27:37.491353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 200/388] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:37 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:37.553132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:37.553946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:37.564176 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.565122 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.565537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.565832 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.796044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:37.804022 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3457ef7-968a-44c6-bde5-d1e31a745dc4 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1504 microversion: 2.1 time: 0.255206 Jan 26 19:27:37.805280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 189/389] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:37 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:37.854678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:37.855882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:37.862967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:37.863543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.864196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.864948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:37.866030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.866673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.876034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.876814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.877655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:37.878335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:37.974903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe4b3a9b-7a5e-4df4-87a9-3032f275c02f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28516 microversion: 2.20 time: 0.117796 Jan 26 19:27:37.975673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 190/390] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:37 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28516 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:38.004246 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-09492f65-2cf6-41d3-9ba1-fd2b78c48546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28527 microversion: 2.1 time: 0.153192 Jan 26 19:27:38.008661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 201/391] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:37 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:38.508493 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:38.509475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:38.518961 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:38.519469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:38.520364 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:38.521223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:38.692933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:38.702067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99d2f717-ef47-400c-addf-c96e230b5677 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1516 microversion: 2.1 time: 0.196792 Jan 26 19:27:38.715648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 191/392] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:38 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:38.822191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:38.823166 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:38.831659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:38.832637 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:38.833725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:38.834441 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:38.988377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:38.989474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:39.016777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:39.020348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:39.027614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:39.028677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:39.117060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:39.125732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5b0ece22-edeb-4d27-9de2-3040943d4271 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1504 microversion: 2.1 time: 0.307525 Jan 26 19:27:39.136778 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 202/393] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:38 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:39.141687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:39.142603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:39.150047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:39.150261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:39.151527 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:39.152166 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:39.185108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a377105e-12d0-48e1-bcd4-8b1a1fc0b03b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28534 microversion: 2.20 time: 0.200838 Jan 26 19:27:39.185852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 192/394] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:38 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28534 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:39.249031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-800c1583-3599-450e-9e07-4b4a32f099d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.110738 Jan 26 19:27:39.253204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 203/395] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:39 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:39.575368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-11c90ace-205c-4047-aea1-d0b79dbeac2a req-6226f383-414b-4366-ae10-28afe4a30547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2c2597-b7d6-4019-9a8c-918a6e84c5ee", "name": "network-vif-deleted", "tag": "0d593cd6-8871-48fa-9a6b-f26cef3519ce"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:39.577267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:27:39.577267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:27:39.586432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-11c90ace-205c-4047-aea1-d0b79dbeac2a req-6226f383-414b-4366-ae10-28afe4a30547 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:39.586879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-11c90ace-205c-4047-aea1-d0b79dbeac2a req-6226f383-414b-4366-ae10-28afe4a30547 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:39.598921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-11c90ace-205c-4047-aea1-d0b79dbeac2a req-6226f383-414b-4366-ae10-28afe4a30547 service nova] Creating event network-vif-deleted:0d593cd6-8871-48fa-9a6b-f26cef3519ce for instance fa2c2597-b7d6-4019-9a8c-918a6e84c5ee on hv-cinder-79400 Jan 26 19:27:39.605282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-11c90ace-205c-4047-aea1-d0b79dbeac2a req-6226f383-414b-4366-ae10-28afe4a30547 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036629 Jan 26 19:27:39.605886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 193/396] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:27:40.144206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:40.144641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:40.151351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:40.152808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:40.158217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.158758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.159622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.160085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.161020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.161863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.162903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.163736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.198179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.198848 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.199561 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lazy-loading 'fault' on Instance uuid fa2c2597-b7d6-4019-9a8c-918a6e84c5ee {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:27:40.305811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:40.313044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-45d5a422-0b21-45ee-b446-e5aec99f498b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 200 len: 1304 microversion: 2.1 time: 0.173540 Jan 26 19:27:40.313688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 204/397] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:40 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:40.323486 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:40.324801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:40.325580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:40.333861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2b2a0d62-68c9-439f-b75d-7ea5105624ac tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1516 microversion: 2.1 time: 0.186962 Jan 26 19:27:40.334447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 194/398] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:40 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:40.337048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.337570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.338421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.338932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.339940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:40.340861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:40.346823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.347273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.348115 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.348549 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.430096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-251f2b18-4261-414d-b77c-1961e4ff756b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.094170 Jan 26 19:27:40.430981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 195/399] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:40 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:40.435740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038d92e7-84a9-49a6-bf5a-02307ef7915d"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:40.436859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:40.443662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.444214 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.445095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:40.445507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:40.448447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f6007985-a50a-44fc-9329-bc5095ee3f92 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.133522 Jan 26 19:27:40.449361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 205/400] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:40 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:40.688355 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cbfdb549-a2f2-45d8-a446-2ec7d3421a58 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256068 Jan 26 19:27:40.688929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 196/401] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:27:40 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:27:41.330331 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:41.331021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: fa2c2597-b7d6-4019-9a8c-918a6e84c5ee] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:41.337929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.338460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.339204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.339554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.358582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] HTTP exception thrown: Instance fa2c2597-b7d6-4019-9a8c-918a6e84c5ee could not be found. Jan 26 19:27:41.359302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Returning 404 to user: Instance fa2c2597-b7d6-4019-9a8c-918a6e84c5ee could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:27:41.360160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-78672c4b-d239-4279-8365-6e8a145d08b1 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee" status: 404 len: 111 microversion: 2.1 time: 0.033789 Jan 26 19:27:41.360914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 206/402] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:41 2022] GET /compute/v2.1/servers/fa2c2597-b7d6-4019-9a8c-918a6e84c5ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:27:41.443290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:41.445084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:41.452314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.453242 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.454371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.455123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.460257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:41.461596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:41.468738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.469188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.470280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.470915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.550720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-456c3af4-a4d9-4b30-b0a9-4975e0052408 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.112232 Jan 26 19:27:41.551468 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 197/403] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:41 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:41.557607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714375448", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "ca72cad8-294c-4f10-8a99-4392c0b5b4f2"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:41.572863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-23da200b-3e02-4e6b-8125-bd1f4fff0f45 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.116223 Jan 26 19:27:41.573713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 207/404] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:41 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:41.612443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] validate_networks() for [('ca72cad8-294c-4f10-8a99-4392c0b5b4f2', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:27:41.945706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:27:41.946116 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:27:41.946574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:27:41.946971 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:27:41.947370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:27:41.955779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.956231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.957026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:41.957454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:41.974644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Getting quotas for project 48cdb224373e4cbca601532981d8f3dc. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:27:41.979034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Getting quotas for user 5640eee1eddd4162a0641516206b7bde and project 48cdb224373e4cbca601532981d8f3dc. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:27:41.989319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:27:41.991628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:27:42.038260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fa75d902-5cfc-4757-ab96-8a0c5f2af67f tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485373 Jan 26 19:27:42.038905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 198/405] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:27:42.050809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3cc507e6-549f-4e36-a623-864156e68c38 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:42.051863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3cc507e6-549f-4e36-a623-864156e68c38 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:42.106998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3cc507e6-549f-4e36-a623-864156e68c38 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:42.113840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3cc507e6-549f-4e36-a623-864156e68c38 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1214 microversion: 2.1 time: 0.068184 Jan 26 19:27:42.114479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 208/406] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:42 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:42.562191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:42.563153 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:42.569566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:42.570009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:42.571399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:42.571854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:42.584095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:42.584998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:42.592252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:42.592711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:42.593504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:42.593945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:49.893274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3b7c3d92-b276-4485-8145-7003ef258c31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 7.312704 Jan 26 19:27:49.893958 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 209/407] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:42 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 7314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:49.898891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:49.899604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:49.907171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:49.907655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:49.908460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:49.908894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:49.910942 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a80a2c80-eab1-42d4-91b7-3ff19e64f1a4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 7.352262 Jan 26 19:27:49.911584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 199/408] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:42 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 7354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:49.971148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:49.979744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9cb343b3-0c1f-4b6a-b5e3-85a03f5c546a tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1266 microversion: 2.1 time: 0.084730 Jan 26 19:27:49.980324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 210/409] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:49 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:50.905107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:50.906145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:50.919114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:50.920627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:50.922087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:50.922372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:50.922800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:50.923640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:50.930840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:50.931280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:50.936446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:50.937004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:51.021774 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-48fb26ce-d96d-4690-a602-c9fbde33eb5d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.120580 Jan 26 19:27:51.026042 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 200/410] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:50 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:51.030909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:51.031619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:51.033378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3ce77dd7-40ea-41b8-8ffc-df4fb616f093 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.115235 Jan 26 19:27:51.034848 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 211/411] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:50 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:51.042397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:51.042848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:51.043643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:51.044394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:51.315001 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:51.322596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-46602019-0a47-4fc9-8fb1-1c1b9384d7f8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.298388 Jan 26 19:27:51.323168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 201/412] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:51 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:51.676204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-6e5cf448-6555-49f5-be8f-2a35c83bd2dd req-50709b1e-046e-42f3-99ed-473bc3195a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ec4b78-79d4-46c3-81dd-03af1bdd0e5b", "tag": "c9350971-db0f-41c5-bc70-56f1a86a2b7b"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:51.678512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:27:51.678512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:27:51.690955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6e5cf448-6555-49f5-be8f-2a35c83bd2dd req-50709b1e-046e-42f3-99ed-473bc3195a4a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:51.691405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6e5cf448-6555-49f5-be8f-2a35c83bd2dd req-50709b1e-046e-42f3-99ed-473bc3195a4a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:51.706322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-6e5cf448-6555-49f5-be8f-2a35c83bd2dd req-50709b1e-046e-42f3-99ed-473bc3195a4a service nova] Creating event network-changed:c9350971-db0f-41c5-bc70-56f1a86a2b7b for instance 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b on hv-cinder-79400 Jan 26 19:27:51.712121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-6e5cf448-6555-49f5-be8f-2a35c83bd2dd req-50709b1e-046e-42f3-99ed-473bc3195a4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050896 Jan 26 19:27:51.713232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 212/413] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:27:52.033710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:52.034742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:52.041613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.042275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.043052 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.043691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.046967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:52.048517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:52.054435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.054886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.055663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.056137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.145551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9d888d47-af34-4748-826f-f4794535a828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.115506 Jan 26 19:27:52.147031 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 202/414] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:52 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:27:52.152832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-93f716c8-2598-423b-80dd-e4d7b98c570c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.110483 Jan 26 19:27:52.156663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 213/415] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:52 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:52.339542 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:52.340270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:52.347854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.348313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.349584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.350021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.387330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:52.388494 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:52.395305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.395794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.396643 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.397071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.420546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lazy-loading 'flavor' on Instance uuid d757f9bf-0099-40a5-aa9d-9c174a3ac859 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:27:52.577118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0065a304-813f-4f67-b53b-e523bb064f0e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action" status: 200 len: 32 microversion: 2.1 time: 0.194479 Jan 26 19:27:52.580167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 214/416] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:52 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 26 19:27:52.587673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:52.588911 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:52.596731 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.597515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.598596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:52.599471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:52.736394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:52.745034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-26c30d33-52fd-499f-8cb6-8964e17a27f5 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.161111 Jan 26 19:27:52.745610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 215/417] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:52 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:52.775680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:52.783225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5f8aa469-87b9-4164-8fff-0ad3f9c4deca tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.447634 Jan 26 19:27:52.784008 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 203/418] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:52 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:53.157284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:53.158248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:53.164194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:53.164653 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.165102 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.165217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:53.166429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.166864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.174457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.174907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.175998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.176445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.241927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c0302d27-be15-44d8-96d7-34c50f66e916 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.088087 Jan 26 19:27:53.242585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 216/419] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:53 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:53.251944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8c930d0-baac-4aae-89a4-fef262b3f0b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.091197 Jan 26 19:27:53.255729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 204/420] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:53 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:53.763783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:53.764491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:53.771305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.771759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.772563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.773003 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.800436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:53.801120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:53.811723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.812376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.813408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:53.813779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:53.910178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:53.918442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cad62cd4-63bf-4228-8c2e-25f6ca6a56a4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.159196 Jan 26 19:27:53.919023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 217/421] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:53 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:53.950454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:53.958040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-966dcd38-7f2b-4e90-b308-f80efea7fbea tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.161662 Jan 26 19:27:53.958617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 205/422] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:53 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:54.255897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:54.255897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:54.262273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.263005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.263886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:54.264538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.264955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:54.265312 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.277320 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.277874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.278759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.279317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.363420 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f114578c-f5aa-4ee4-8be2-423c45e03634 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.112762 Jan 26 19:27:54.364110 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 218/423] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:54 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:54.369705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2fa9e8bd-4c3a-4706-a6dc-efb8d0f8ee20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.109828 Jan 26 19:27:54.373648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 206/424] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:54 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:54.934480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:54.935177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:54.942328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.942785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.943597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.944057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.975068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:54.975760 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:54.982926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.984026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:54.984808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:54.985235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:55.085851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:55.094235 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e7d23a12-afb6-4081-9c34-158061136aa0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.163644 Jan 26 19:27:55.094805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 219/425] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:54 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:55.132742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:55.140666 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3f530c64-5178-42a7-adf2-de20855269dd tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.169590 Jan 26 19:27:55.141457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 207/426] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:54 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:55.375451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:55.376907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:55.381442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:55.382522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:55.383807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:55.384318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:55.385703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:55.386376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:55.391068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:55.391456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:55.392271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:55.392715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:55.468578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-30c0b31d-d015-4a54-bd71-3d1cf458fec9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.096674 Jan 26 19:27:55.469473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 220/427] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:55 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:55.477654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e5ebd7b6-0efb-4bff-8163-e09fe65632a7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.100042 Jan 26 19:27:55.478601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 208/428] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:55 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:56.111226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:56.112173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:56.119251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.119947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.121332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.121776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.159868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:56.160587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:56.171091 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.174835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.176019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.180237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.285273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:56.295631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c1bb6f18-05fc-4209-9c44-0ea6dd8b9d6f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.188162 Jan 26 19:27:56.297473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 221/429] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:56 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:56.335484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:56.343420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa6f7a6b-39bc-4618-a00e-513906bf6575 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.188566 Jan 26 19:27:56.344121 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 209/430] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:56 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:56.480708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:56.481605 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:56.487951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.488522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.489391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:56.489857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.490016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.490287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:56.496372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.497007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.497941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:56.498522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:56.641488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-60e44829-e808-4d67-b180-3de59a627abc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.163882 Jan 26 19:27:56.642087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 222/431] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:56 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:56.647382 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-482a2c7a-18f7-45b6-9e4d-d923fba01851 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.161090 Jan 26 19:27:56.649202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 210/432] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:56 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:57.313760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:57.314454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:57.321290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.321758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.322509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.322944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.360306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:57.360984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:57.367991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.368433 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.369890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.370315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.448684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:57.456582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dacf8fef-b296-41d2-87ae-810a3bacde76 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.146786 Jan 26 19:27:57.457155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 223/433] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:57 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:57.497104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:57.504679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0df18ce7-e0f6-4bb7-b171-2fbed6e33a1c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.148271 Jan 26 19:27:57.505227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 211/434] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:57 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:57.653720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:57.654553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:57.660777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.661217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.661984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.662408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.662652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:57.663634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:57.669423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.669863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.670621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:57.671048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:57.730539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8ca8ad11-7c42-431e-b50e-5c06af9f7018 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.080379 Jan 26 19:27:57.732072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 224/435] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:57 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:57.735002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-34fa577a-a3ae-4959-8f23-06932571496b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.076586 Jan 26 19:27:57.735634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 212/436] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:57 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:27:58.474495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:58.475211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:58.482474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.482917 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.483677 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.484135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.522253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:58.522948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:58.530480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.530931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.531705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.532169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.608472 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:58.616586 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9d64bc6d-8141-42a8-9d28-840a68e12c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.146069 Jan 26 19:27:58.617154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 225/437] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:58 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:58.659902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:58.667465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f5c4b1f2-a41f-4a79-b0af-96f756509e36 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.149223 Jan 26 19:27:58.668047 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 213/438] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:58 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:27:58.742177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:58.743325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:58.745928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:58.746835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:58.750082 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.750629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.751477 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.752033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.752520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.753080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.753897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:58.754309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:58.842605 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-79f61e9c-2236-410c-9992-ab382a0d2aa9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.100431 Jan 26 19:27:58.843258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 214/439] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:58 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:27:58.848140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2106919127", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:58.872090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b9e11b78-73b3-4eaa-835c-6f120ca0d769 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.133592 Jan 26 19:27:58.872735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 226/440] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:58 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:27:58.897139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] validate_networks() for None {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:27:59.152714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:27:59.153128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:27:59.153588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:27:59.153988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:27:59.154393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:27:59.163005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.163447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.164289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.164722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.180950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Getting quotas for project 4c805b604131432ba187e0ae556a0000. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:27:59.185447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Getting quotas for user 10ef367719ab441da3d5d50013d44cd3 and project 4c805b604131432ba187e0ae556a0000. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:27:59.195748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:27:59.198694 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:27:59.239895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-250645a8-9e8f-40a5-b6b1-a62fa530af9e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.395342 Jan 26 19:27:59.240544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 215/441] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:27:59.250888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fd440235-e869-48da-a009-436f18fdde04 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:59.251599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fd440235-e869-48da-a009-436f18fdde04 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:59.515638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fd440235-e869-48da-a009-436f18fdde04 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:59.523260 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fd440235-e869-48da-a009-436f18fdde04 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1215 microversion: 2.1 time: 0.276215 Jan 26 19:27:59.524278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 227/442] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:59 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:59.548647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-6c5c2752-9850-4ddb-b573-32fbe4e15a72 req-275798c0-57f3-44e4-a222-ac1f4d5cbfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ec4b78-79d4-46c3-81dd-03af1bdd0e5b", "name": "network-vif-plugged", "status": "completed", "tag": "c9350971-db0f-41c5-bc70-56f1a86a2b7b"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:59.550788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:27:59.550788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:27:59.564370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6c5c2752-9850-4ddb-b573-32fbe4e15a72 req-275798c0-57f3-44e4-a222-ac1f4d5cbfa9 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.564818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6c5c2752-9850-4ddb-b573-32fbe4e15a72 req-275798c0-57f3-44e4-a222-ac1f4d5cbfa9 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.583763 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-6c5c2752-9850-4ddb-b573-32fbe4e15a72 req-275798c0-57f3-44e4-a222-ac1f4d5cbfa9 service nova] Creating event network-vif-plugged:c9350971-db0f-41c5-bc70-56f1a86a2b7b for instance 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b on hv-cinder-79400 Jan 26 19:27:59.589520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-6c5c2752-9850-4ddb-b573-32fbe4e15a72 req-275798c0-57f3-44e4-a222-ac1f4d5cbfa9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044685 Jan 26 19:27:59.590406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 216/443] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:27:59.633447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:59.634342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:59.641501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.641955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.642741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.643200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.685837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:27:59.686689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:59.693646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.694339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.695169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.695606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.792185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:59.801031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-76385737-72a9-4bd2-a174-1163c5eb975b tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.171063 Jan 26 19:27:59.801770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 228/444] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:59 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:59.855132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:59.856318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:59.865496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.868313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.869303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.869744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.905133 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:27:59.917532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-377c7cd8-d023-4019-8b99-f224d9a52ebf tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.236599 Jan 26 19:27:59.918402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 217/445] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:27:59 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:27:59.925546 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:27:59.926496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:27:59.934924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.935367 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:27:59.936158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:27:59.936587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.229502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-86a20a9f-a501-4ac0-a0a2-682f7d305493 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.378942 Jan 26 19:28:00.231151 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 229/446] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:27:59 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:00.234290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e5c21bfe-c660-4585-b248-2bdd33a942b5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.314380 Jan 26 19:28:00.238287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 218/447] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:27:59 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:00.541539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:00.542233 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:00.549211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.549673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.550462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.550900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.612894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:00.621438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d763f2af-4ed0-4a71-9ed3-1de5b7337e32 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1275 microversion: 2.1 time: 0.083979 Jan 26 19:28:00.629423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 230/448] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:00 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:00.817973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:00.818689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:00.826101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.826629 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.827340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.827788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.935114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:00.936861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:00.943545 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.944024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:00.944805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:00.945408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.057959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:01.066918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2c008e87-605e-477f-8dc4-d461f97f4739 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.253013 Jan 26 19:28:01.067741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 219/449] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:00 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:01.082523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:01.089626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9e5a8947-c760-456f-ac31-eb6bb9788608 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1314 microversion: 2.1 time: 0.158776 Jan 26 19:28:01.090185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 231/450] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:00 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:01.241502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:01.242562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:01.246320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:01.247279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:01.249392 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.249830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.250602 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.251032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.254085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.254528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.255467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.255954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.340773 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5766b184-5a85-4b96-a7ef-1b0aa2d992ca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.102745 Jan 26 19:28:01.341928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 220/451] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:01 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:01.359181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e405b1e5-78d3-4455-bdbc-371fe14ca1f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.116667 Jan 26 19:28:01.363648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 232/452] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:01 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:01.639861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:01.640503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:01.647395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.647878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.648915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:01.649346 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:01.848410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:01.856062 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-af8e2439-b1ad-4e90-be1a-eabef57e5cdd tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.220300 Jan 26 19:28:01.856684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 221/453] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:01 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:02.085200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:02.085905 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.093118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.093568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.094355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.094791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.107424 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:02.108285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.116260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.116728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.117516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.117946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.265839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:02.274396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-53059bc5-2d6f-438e-bdcf-f673512826e6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.193213 Jan 26 19:28:02.275320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 233/454] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:02 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:02.289569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:02.290480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-bc529819-f82f-4dfb-b648-d51bf4fc1728 req-c7e981fd-36a0-4375-8353-ca35afc416e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f006c-b716-4410-bba1-05de94473fe5", "tag": "c7c759d4-1239-4c98-b78d-215f759299f6"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:02.292065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:02.292065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:28:02.302235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4a070a3c-0666-4165-a8d9-e98260374aa8 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1497 microversion: 2.1 time: 0.198928 Jan 26 19:28:02.302809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 222/455] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:02 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:02.304555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-bc529819-f82f-4dfb-b648-d51bf4fc1728 req-c7e981fd-36a0-4375-8353-ca35afc416e7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.304997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-bc529819-f82f-4dfb-b648-d51bf4fc1728 req-c7e981fd-36a0-4375-8353-ca35afc416e7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.320139 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-bc529819-f82f-4dfb-b648-d51bf4fc1728 req-c7e981fd-36a0-4375-8353-ca35afc416e7 service nova] Creating event network-changed:c7c759d4-1239-4c98-b78d-215f759299f6 for instance 298f006c-b716-4410-bba1-05de94473fe5 on hv-cinder-79400 Jan 26 19:28:02.325699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-bc529819-f82f-4dfb-b648-d51bf4fc1728 req-c7e981fd-36a0-4375-8353-ca35afc416e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049084 Jan 26 19:28:02.326479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 234/456] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:02.352178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:02.353908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.362287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.362750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.363546 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.364026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.375335 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:02.376362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.382819 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.383289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.384190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.385530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.432598 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1d61a949-f3c1-4869-b276-45649f4271d3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.083838 Jan 26 19:28:02.435827 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 223/457] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:02 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:02.472233 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-03ddd334-617f-4ef3-a1b2-706ccd00ee84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.104624 Jan 26 19:28:02.472904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 235/458] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:02 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:02.751978 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:02.752556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.759275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.759716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.760514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.760936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.788465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:28:02.865926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c8cf834c-0ff7-457a-8ac1-3864b2d20c55 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "DELETE /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 204 len: 0 microversion: 2.1 time: 0.117668 Jan 26 19:28:02.866651 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 224/459] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:28:02 2022] DELETE /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:28:02.873580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:02.874572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.877681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:02.878368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:02.881712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.882926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.883818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.884061 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.884419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.884552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:02.885267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:02.885698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.028261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:03.037479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4e5e6d24-47fe-4a43-a3b1-16b8e91303d2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.167985 Jan 26 19:28:03.044556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 236/460] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:02 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:03.109646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:03.117162 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d23e848e-95d6-4586-85bc-77968a77db7c tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1503 microversion: 2.1 time: 0.245632 Jan 26 19:28:03.117723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 225/461] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:02 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:03.292390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:03.293007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:03.299332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.299790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.300591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.301025 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.439347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:03.444245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:03.445243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:03.448993 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f375a936-f1d4-4641-84b3-63f72b8344af tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.161229 Jan 26 19:28:03.449571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 237/462] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:03 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:03.454226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.454676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.455488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.455968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.484195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:03.485165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:03.490907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.491557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.492363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:03.492798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:03.630481 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5737b9ed-8d40-46eb-8d8c-70a3a840c710 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.189607 Jan 26 19:28:03.631151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 226/463] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:03 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:03.674079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-953101a7-ca08-47d8-bc64-7b799928a406 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.193993 Jan 26 19:28:03.674764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 238/464] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:03 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:04.054154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:04.054849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:04.062575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.063030 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.063833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.064272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.136243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:04.137181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:04.144658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.145208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.145897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.146337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.195432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:04.203290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-361776d1-1615-47ca-a83c-525f06b0d88b tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.153108 Jan 26 19:28:04.204263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 227/465] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:04 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:04.292530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:04.302194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6ace000c-6e74-476b-9a4a-e33244c4037b tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1503 microversion: 2.1 time: 0.170664 Jan 26 19:28:04.302943 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 239/466] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:04 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:04.466431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:04.467287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:04.473995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.474486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.475339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.476008 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.611444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:04.619607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1d1b8de5-da4d-4645-9dd7-1fd67c8c34d4 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.157587 Jan 26 19:28:04.620308 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 228/467] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:04 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:04.642518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:04.643578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:04.650705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.651151 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.651949 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.652384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.685469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:04.686423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:04.692436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.692879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.693653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:04.694078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:04.728327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-40d9c995-47b4-47ee-b1e8-9649268a9e16 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.089376 Jan 26 19:28:04.729247 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 240/468] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:04 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:04.787539 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-306e2e34-7952-4432-980a-577e928fb6ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.105460 Jan 26 19:28:04.788271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 229/469] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:04 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:05.220252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:05.220951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:05.227882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.228338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.229133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.229640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.318976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:05.319678 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:05.327103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.327920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.328744 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.329184 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.374734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:05.382218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3d201ffc-0ca3-4810-938f-38c3859f1d2f tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.166032 Jan 26 19:28:05.382780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 241/470] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:05 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:05.529351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5640eee1eddd4162a0641516206b7bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48cdb224373e4cbca601532981d8f3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:05.538405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-09f19635-64dd-4cd4-97e2-87fa021f0e61 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 200 len: 1503 microversion: 2.1 time: 0.223418 Jan 26 19:28:05.538976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 230/471] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:05 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:05.617022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-cdfc913b-bf6e-4793-8d74-29781e672a54 req-2159c763-c24b-46b4-9a33-525c19c2083b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ec4b78-79d4-46c3-81dd-03af1bdd0e5b", "name": "network-vif-deleted", "tag": "c9350971-db0f-41c5-bc70-56f1a86a2b7b"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:05.619168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:05.619168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:28:05.627725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-cdfc913b-bf6e-4793-8d74-29781e672a54 req-2159c763-c24b-46b4-9a33-525c19c2083b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.628189 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-cdfc913b-bf6e-4793-8d74-29781e672a54 req-2159c763-c24b-46b4-9a33-525c19c2083b service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.636097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:05.636840 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:05.640338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-cdfc913b-bf6e-4793-8d74-29781e672a54 req-2159c763-c24b-46b4-9a33-525c19c2083b service nova] Creating event network-vif-deleted:c9350971-db0f-41c5-bc70-56f1a86a2b7b for instance 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b on hv-cinder-79400 Jan 26 19:28:05.645325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-cdfc913b-bf6e-4793-8d74-29781e672a54 req-2159c763-c24b-46b4-9a33-525c19c2083b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Jan 26 19:28:05.648722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.649279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 242/472] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:05.649734 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.650524 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.650955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.739882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:05.740889 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:05.748237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.748828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.749611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.750047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.817851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:05.826568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-691ed9ef-53e0-4d5c-837a-4df5f0230e7c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.194142 Jan 26 19:28:05.827125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 231/473] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:05 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:05.831550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:05.832460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:05.838550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.839014 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.839797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:05.840219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:05.842724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2c06f9df-73e9-4d79-9eab-3046cc477485 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.107030 Jan 26 19:28:05.844502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 243/474] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:05 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:05.958665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5d170e57-781b-4116-87ac-b995212da0fb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.129887 Jan 26 19:28:05.959341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 232/475] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:05 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:06.399020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:06.399725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:06.407210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.407663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.408478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.408915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.533035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:06.540616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1c6c79bb-381c-45b2-b16f-447c2469c2c2 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.145868 Jan 26 19:28:06.541184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 244/476] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:06 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:06.556071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:06.557208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] [instance: 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:06.563926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.564368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.565123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.565547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.579613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] HTTP exception thrown: Instance 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b could not be found. Jan 26 19:28:06.580220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] Returning 404 to user: Instance 28ec4b78-79d4-46c3-81dd-03af1bdd0e5b could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:28:06.581016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-acb2b9f0-b849-4fc1-a678-35c21496d740 tempest-VolumesActionsTest-597470851 tempest-VolumesActionsTest-597470851-project] 10.222.0.50 "GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b" status: 404 len: 111 microversion: 2.1 time: 0.029009 Jan 26 19:28:06.581530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 233/477] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:06 2022] GET /compute/v2.1/servers/28ec4b78-79d4-46c3-81dd-03af1bdd0e5b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:28:06.842019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:06.842626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:06.849279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.849901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.851542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.852006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.857140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:06.858422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:06.865431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.866120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.867376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.868743 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.969552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb8067b9-3adc-473a-aa6f-20111695b7c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.118982 Jan 26 19:28:06.970197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 234/478] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:06 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:06.976283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:06.977274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:06.984833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.985457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:06.986253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:06.986686 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:07.012066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:07.020835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-36441e53-5f6a-4806-9020-63e977db1325 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.182478 Jan 26 19:28:07.021601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 245/479] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:06 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:07.111176 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac0101c0-233b-46e4-beea-95dfc10bdb3b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.139425 Jan 26 19:28:07.116086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 235/480] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:06 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:07.557810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:07.558423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-aff2c5c9-bb99-41a2-b09c-13ce55c384b7 req-0c854b79-38bf-4ede-b411-872eab19791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f006c-b716-4410-bba1-05de94473fe5", "name": "network-vif-plugged", "status": "completed", "tag": "c7c759d4-1239-4c98-b78d-215f759299f6"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:07.559663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:07.559663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:28:07.560346 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:07.568522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-aff2c5c9-bb99-41a2-b09c-13ce55c384b7 req-0c854b79-38bf-4ede-b411-872eab19791f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:07.568987 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-aff2c5c9-bb99-41a2-b09c-13ce55c384b7 req-0c854b79-38bf-4ede-b411-872eab19791f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:07.569507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:07.570190 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:07.571176 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:07.572019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:07.581655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-aff2c5c9-bb99-41a2-b09c-13ce55c384b7 req-0c854b79-38bf-4ede-b411-872eab19791f service nova] Creating event network-vif-plugged:c7c759d4-1239-4c98-b78d-215f759299f6 for instance 298f006c-b716-4410-bba1-05de94473fe5 on hv-cinder-79400 Jan 26 19:28:07.587018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-aff2c5c9-bb99-41a2-b09c-13ce55c384b7 req-0c854b79-38bf-4ede-b411-872eab19791f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Jan 26 19:28:07.588485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 246/481] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:07.794032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:07.801148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1f58c8a6-baf6-44df-8ab8-31892c479d7e tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.248441 Jan 26 19:28:07.801646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 236/482] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:07 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:07.982039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:07.983353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:07.989919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:07.990363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:07.991144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:07.991617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:08.038021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:08.038626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:08.046131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:08.046580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:08.047361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:08.047809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:08.178438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:08.185996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-46d871c8-6bdd-4cfa-b8f4-c656a7f18bb9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.151567 Jan 26 19:28:08.186548 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 237/483] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:08 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:08.190947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:08.191909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:08.197205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:08.197647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:08.198405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:08.198830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:11.630407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b2d6039e-2d49-438a-91a4-2188eadd324f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 3.652882 Jan 26 19:28:11.634530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 247/484] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:07 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 3655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:11.634655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0967a9bd-1bcb-453e-90d6-e8a3c3914a27 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 3.446258 Jan 26 19:28:11.635102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 238/485] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:08 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 3448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:11.637208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:11.637907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:11.643701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:11.644456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:11.644711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:11.645160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:11.645939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:11.646501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:11.651977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:11.652427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:11.653197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:11.653631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:11.774493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:11.779147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:11.782345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-618eab34-ea6a-4867-a966-f4bb6fa75dce tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.149685 Jan 26 19:28:11.782914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 248/486] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:11 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:11.787105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-74d216ba-8be7-422e-aef9-1f5b056092a8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.147168 Jan 26 19:28:11.787643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 239/487] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:11 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:12.644893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:12.645839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:12.647037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:12.648881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:12.655642 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.656489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.656816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.657294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.657738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.658015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.659225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.661891 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.735090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-abb77ada-167d-4334-9c1f-5f3e1e066f6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.096617 Jan 26 19:28:12.736505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 249/488] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:12 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:12.744278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5cb34c13-5d5a-4c99-baaa-fc3726592c83 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.101040 Jan 26 19:28:12.748432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 240/489] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:12 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:12.805709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:12.806405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:12.809281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:12.810757 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:12.814636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.815269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.816618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.817059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.820201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.821050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.824352 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:12.824995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:12.984984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:12.994621 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9d9fb074-cc17-4913-9742-ad8570867568 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.193498 Jan 26 19:28:13.005059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 250/490] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:12 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:13.023187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:13.031139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-470f97f3-f66c-428c-b308-ec0495cc8567 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1315 microversion: 2.1 time: 0.228358 Jan 26 19:28:13.031708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 241/491] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:12 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:13.764558 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:13.765820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:13.767075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:13.767691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:13.795751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:13.796777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:13.797831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:13.799945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:13.801930 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:13.803148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:13.804262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:13.807295 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:13.921366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eeb7ae2c-52a7-42ef-9ae7-b94308d2697f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.177518 Jan 26 19:28:13.922412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 251/492] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:13 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:13.930646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5300a7c1-4959-4c12-8576-ac3d4363e242 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.178890 Jan 26 19:28:13.931638 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 242/493] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:13 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:14.014248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:14.015120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.022863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.024001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.024646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.025234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.048799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:14.049712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.064977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.065879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.068280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.068877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.217375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:14.225444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a64aac09-06d5-4ab8-b638-5b385cc37c8a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.215133 Jan 26 19:28:14.226238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 252/494] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:14 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:14.284382 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:14.295646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-769d77b4-46e7-47c1-9d85-aa40b81b54ab tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1465 microversion: 2.1 time: 0.251072 Jan 26 19:28:14.297356 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 243/495] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:14 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:14.347081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:14.348471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.363320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.364578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.366408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.367585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.465223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:28:14.577863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9fb82eb1-8d1b-428f-b908-f19c373d71f4 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "DELETE /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 204 len: 0 microversion: 2.1 time: 0.239565 Jan 26 19:28:14.578657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 253/496] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:28:14 2022] DELETE /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:28:14.586413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:14.587500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.601073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.602821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.604095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.604761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.828952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:14.861110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-61c78d15-5e00-4262-ab51-7c1044ad55fc tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1471 microversion: 2.1 time: 0.278084 Jan 26 19:28:14.862321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 244/497] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:14 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:14.938597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:14.941103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.944357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:14.945412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:14.953253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.953718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.954139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.954855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.956408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.957088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:14.964575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:14.965031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:15.037835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d0e75ac1-6f1f-431e-9747-5e2539486276 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.097122 Jan 26 19:28:15.038997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 245/498] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:14 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:15.076209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4ff5d693-2615-4e22-b337-d9103dca48bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.145660 Jan 26 19:28:15.076886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 254/499] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:14 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:15.244498 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:15.245924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:15.258715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:15.259342 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:15.260324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:15.260848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:15.418028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:15.428963 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-85288a30-27dc-4f98-b6ab-6d92c55304cc tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.188460 Jan 26 19:28:15.431872 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 246/500] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:15 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:15.882327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:15.883654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:15.896340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:15.898252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:15.899602 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:15.900457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.049672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:16.050934 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:16.058048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.058617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.061773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:16.065101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.065364 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.069035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8549177-ce03-4f95-aece-1034c9750c71 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1471 microversion: 2.1 time: 0.191137 Jan 26 19:28:16.069608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 255/501] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:15 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:16.090030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:16.091111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:16.097264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.097705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.098494 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.098929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.514175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a8e7875-8382-4215-9329-dba2bc086d2d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.468063 Jan 26 19:28:16.514972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 247/502] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:16 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:16.518902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-31868b86-209a-4d89-9c21-cf22c5736bec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.432793 Jan 26 19:28:16.519526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 256/503] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:16 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:16.520583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:16.521341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:16.530039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.530839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.531874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:16.532502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:16.663990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-725284007", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "cb61a227-3f6a-4a64-829c-bff22f962c01"}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:16.708661 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:16.718120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ff6aa37-c77b-4a6e-ac71-f999dfbb2c56 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.201375 Jan 26 19:28:16.726857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] validate_networks() for [('cb61a227-3f6a-4a64-829c-bff22f962c01', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:28:16.727514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 248/504] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:16 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:17.088119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:17.089416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:17.097634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.100383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.101482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.103508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.154313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:28:17.154904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:28:17.155091 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:28:17.155676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:28:17.156286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:28:17.167610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.168288 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.169293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.169901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.188949 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Getting quotas for project cf8d9c9de7c8480db8e23bb4bac96785. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:28:17.193388 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Getting quotas for user 18d1dd6d9d0940d594152a246259a18b and project cf8d9c9de7c8480db8e23bb4bac96785. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:28:17.206185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:28:17.209772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:28:17.264170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c3125979-42e6-45e6-b13c-d6c511c1ca99 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605006 Jan 26 19:28:17.265221 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 257/505] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:28:17.276239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fc256e03-cd7c-411d-bc16-aedd5fc9649c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:17.277258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fc256e03-cd7c-411d-bc16-aedd5fc9649c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:17.376520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ef367719ab441da3d5d50013d44cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c805b604131432ba187e0ae556a0000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:17.382599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc256e03-cd7c-411d-bc16-aedd5fc9649c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:17.386809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6f241d4b-51c9-4eea-8959-f9aadb90b353 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 200 len: 1471 microversion: 2.1 time: 0.303929 Jan 26 19:28:17.387632 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 249/506] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:17 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:17.408045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fc256e03-cd7c-411d-bc16-aedd5fc9649c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1218 microversion: 2.1 time: 0.135532 Jan 26 19:28:17.411129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 258/507] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:17 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:17.528535 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:17.529462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:17.532821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:17.535189 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:17.538694 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.541088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.544370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.544821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.547197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.547654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.551373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.551519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.675009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1de60dcb-9077-4664-a3a2-e4f74e2662ea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.150565 Jan 26 19:28:17.676393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 250/508] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:17 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:17.690273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-85321ea9-da15-4bfd-9ec1-e1a537b83d6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.159020 Jan 26 19:28:17.693819 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 259/509] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:17 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:17.722835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-ba880343-536e-4ed0-b12b-329f6db0dfc3 req-051244d9-ec93-4f7a-8bce-71f46309d203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f006c-b716-4410-bba1-05de94473fe5", "name": "network-vif-deleted", "tag": "c7c759d4-1239-4c98-b78d-215f759299f6"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:17.724558 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:17.724558 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:28:17.734783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:17.735473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:17.742853 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ba880343-536e-4ed0-b12b-329f6db0dfc3 req-051244d9-ec93-4f7a-8bce-71f46309d203 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.743868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ba880343-536e-4ed0-b12b-329f6db0dfc3 req-051244d9-ec93-4f7a-8bce-71f46309d203 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.754645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.755342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.758149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:17.758775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:17.766540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-ba880343-536e-4ed0-b12b-329f6db0dfc3 req-051244d9-ec93-4f7a-8bce-71f46309d203 service nova] Creating event network-vif-deleted:c7c759d4-1239-4c98-b78d-215f759299f6 for instance 298f006c-b716-4410-bba1-05de94473fe5 on hv-cinder-79400 Jan 26 19:28:17.787480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-ba880343-536e-4ed0-b12b-329f6db0dfc3 req-051244d9-ec93-4f7a-8bce-71f46309d203 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064995 Jan 26 19:28:17.788497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 251/510] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:18.013355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:18.022624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-786158da-34d8-426f-bcbb-194aea72b7d0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1568 microversion: 2.1 time: 0.291798 Jan 26 19:28:18.031980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 260/511] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:17 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:18.405174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:18.405987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] [instance: 298f006c-b716-4410-bba1-05de94473fe5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:18.415108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.415465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.416205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.416892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.427220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:18.428601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:18.435603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.443105 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.444004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.444450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.449970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] HTTP exception thrown: Instance 298f006c-b716-4410-bba1-05de94473fe5 could not be found. Jan 26 19:28:18.450572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] Returning 404 to user: Instance 298f006c-b716-4410-bba1-05de94473fe5 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:28:18.451401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f4c3b083-494e-405a-b0f1-3fbeb9acd874 tempest-VolumesNegativeTest-1865735747 tempest-VolumesNegativeTest-1865735747-project] 10.222.0.50 "GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5" status: 404 len: 111 microversion: 2.1 time: 0.051347 Jan 26 19:28:18.452480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 252/512] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:18 2022] GET /compute/v2.1/servers/298f006c-b716-4410-bba1-05de94473fe5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:28:18.565696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:18.577032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0ec52dae-4349-468b-aefa-67c02e6f68b6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1270 microversion: 2.1 time: 0.152850 Jan 26 19:28:18.578328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 261/513] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:18 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:18.687521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:18.688739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:18.698967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.705021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:18.706419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:18.716396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.719044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.719574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.725636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.726673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.732167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:18.732698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:18.820569 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1ef64163-746d-49aa-9a5f-9f5624050b8e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.119071 Jan 26 19:28:18.821652 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 262/514] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:18 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:18.852928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e71dc0e3-83bf-46f3-865e-cb0027fc61bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.169300 Jan 26 19:28:18.853708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 253/515] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:18 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:19.043022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:19.044912 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.053463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.054165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.055763 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.056664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.217408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:19.225837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-23e0fa58-7b6e-4ee1-8a53-258e51b092b8 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1548 microversion: 2.1 time: 0.189988 Jan 26 19:28:19.226823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 263/516] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:19 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:19.243116 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:19.244200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.254716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.255432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.257080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.259728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.583318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] HTTP exception thrown: Cannot 'detach_volume' instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 while it is in vm_state rescued Jan 26 19:28:19.584089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Returning 409 to user: Cannot 'detach_volume' instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 while it is in vm_state rescued {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:28:19.584815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b8a9c6de-d87b-4e40-9ef5-62b2b03732b9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments/038d92e7-84a9-49a6-bf5a-02307ef7915d" status: 409 len: 152 microversion: 2.1 time: 0.346366 Jan 26 19:28:19.594249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:19.594829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.596489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 254/517] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:28:19 2022] DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments/038d92e7-84a9-49a6-bf5a-02307ef7915d => generated 152 bytes in 359 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 26 19:28:19.604877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.605243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.606030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.606692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.612512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:19.613152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.636759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.637275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.639808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.641036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.731161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b53c59f4-aff9-4e5e-a658-6ebc18d99b11 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action" status: 202 len: 0 microversion: 2.1 time: 0.139316 Jan 26 19:28:19.731848 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 264/518] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:19 2022] POST /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:19.758896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:19.764103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:19.766084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.772745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d219d2a4-fb8c-42c0-ab6a-ee3fd55e87d6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1276 microversion: 2.1 time: 0.175134 Jan 26 19:28:19.774703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 255/519] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:19 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:19.805965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.806460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.807628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.808506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.839406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:19.841169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:19.849919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.850791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.852756 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:19.853400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:19.969346 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-389250b1-547f-45cc-8831-f60457ee66bc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.138529 Jan 26 19:28:19.976893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 256/520] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:19 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:19.983252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:19.988545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:20.013324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:20.013911 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:20.014787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:20.016971 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:20.062608 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:20.071521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-36faa91b-5de6-48a0-afb1-d00fc491c04c tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1556 microversion: 2.1 time: 0.321620 Jan 26 19:28:20.077068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 265/521] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:19 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1556 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:20.110273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-179b37b3-093f-43e6-9591-fa1aa94a2603 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.130793 Jan 26 19:28:20.119994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 257/522] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:19 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:20.791845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:20.793086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:20.802179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:20.805437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:20.806367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:20.806842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:20.981709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:20.982880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:20.998341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:20.998673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:20.998819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.006329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6ceec235-0974-41c6-aa1d-1e63fae524ea tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.218525 Jan 26 19:28:21.010828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.011287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.018182 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 266/523] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:20 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:21.081294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-89ddc89e-e212-444c-b640-fb285dcf53be tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.103292 Jan 26 19:28:21.086057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 258/524] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:20 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:21.095919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:21.095919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:21.103319 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.103654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.104982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.105407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.129445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:21.130733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:21.148703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.154499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.159192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.160385 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.315814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d4ef5683-cf69-4e67-b058-84e96d3477e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.192258 Jan 26 19:28:21.320897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 259/525] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:21 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:21.335553 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-cda0cdce-a8cb-41f0-bde4-a3f33f442460 req-3a9f98a1-6cb4-4038-8ed2-33c079045210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bff8c8-e41b-421a-bf67-a4538f83efbc", "tag": "710bf98d-993e-427e-8c77-bdda25d5f13d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:21.342751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:21.342751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:28:21.348743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:21.357090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cda0cdce-a8cb-41f0-bde4-a3f33f442460 req-3a9f98a1-6cb4-4038-8ed2-33c079045210 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:21.357568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fd274b23-3c6a-4cce-b5b6-aee43dd3f7cb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1556 microversion: 2.1 time: 0.265944 Jan 26 19:28:21.359292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cda0cdce-a8cb-41f0-bde4-a3f33f442460 req-3a9f98a1-6cb4-4038-8ed2-33c079045210 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:21.359837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 267/526] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:21 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1556 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:21.393022 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-cda0cdce-a8cb-41f0-bde4-a3f33f442460 req-3a9f98a1-6cb4-4038-8ed2-33c079045210 service nova] Creating event network-changed:710bf98d-993e-427e-8c77-bdda25d5f13d for instance 94bff8c8-e41b-421a-bf67-a4538f83efbc on hv-cinder-79400 Jan 26 19:28:21.398634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-cda0cdce-a8cb-41f0-bde4-a3f33f442460 req-3a9f98a1-6cb4-4038-8ed2-33c079045210 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075819 Jan 26 19:28:21.399537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 260/527] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:22.024606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:22.025107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:22.032787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.033500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.035074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.036183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.093725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:22.095467 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:22.133463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.133945 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.134805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.135314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.264916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:22.274451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-78fc0412-8ba9-416e-9672-37ac3dd7a18a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.253872 Jan 26 19:28:22.284387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 268/528] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:22 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:22.309985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72dbafec-2a1c-421a-9cb7-8be130e3c46e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.220043 Jan 26 19:28:22.311491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 261/529] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:22 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:22.328381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:22.339390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:22.350684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.351142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.354891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.357189 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.374848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:22.375601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:22.382478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.383270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.384309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:22.385065 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:22.445107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-afc771ca-9847-49e9-84f3-e747b0bd07bf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.120121 Jan 26 19:28:22.450750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 269/530] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:22 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:22.592438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:22.608231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e17d9ac6-1638-4c12-b963-b22bc4f113c1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1556 microversion: 2.1 time: 0.235701 Jan 26 19:28:22.609169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 262/531] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:22 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:23.295027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:23.295732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:23.303568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.304033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.304876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.305250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.321640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:23.323394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:23.330487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.331321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.332210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.332995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.430096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9498c74f-d30c-4540-b251-35cf888251f3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.111135 Jan 26 19:28:23.430745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 263/532] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:23 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:23.458065 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:23.459287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:23.467382 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.468162 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.469153 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.469781 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.490628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:23.498361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b9e7ee2a-109b-46a4-89fe-64af6617403c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.207895 Jan 26 19:28:23.498976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 270/533] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:23 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:23.625961 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:23.626865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:23.634133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.635080 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.636390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:23.637092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:23.638805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-34967ffd-17e2-4e96-8ee9-271ccf01b78c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.183334 Jan 26 19:28:23.640854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 264/534] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:23 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:23.783216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:23.794875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-740b808a-622f-4d01-be18-b1670ccbaec0 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1556 microversion: 2.1 time: 0.172505 Jan 26 19:28:23.795631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 271/535] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:23 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:24.445175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:24.446844 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:24.454247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.454976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.457924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.459188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.515133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:24.516083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:24.522845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.523302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.524689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.525133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.553051 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4f7df8db-e136-4363-802d-ca5cbe84e29f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.113513 Jan 26 19:28:24.554312 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 265/536] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:24 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:24.656145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:24.657239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:24.665350 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.665723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.667675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.668222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.720764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:24.738675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-52b6330a-7511-4f23-8dbe-3d990b20a3b9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.087903 Jan 26 19:28:24.744723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 266/537] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:24 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:24.745500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c1a463b3-f9c9-460a-8e1f-cc95e9c371e1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.219537 Jan 26 19:28:24.746642 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 272/538] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:24 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:28:24.814757 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:24.815430 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:24.822955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.823500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:24.824629 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:24.825141 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.170664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:25.178997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3ed6dbb-dfef-4fce-bb90-dd00d3f9f561 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1562 microversion: 2.1 time: 0.368264 Jan 26 19:28:25.190192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 267/539] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:24 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1562 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:25.265857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:25.266596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:25.274136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.274940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.276660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.277248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.436185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lazy-loading 'services' on Instance uuid d757f9bf-0099-40a5-aa9d-9c174a3ac859 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:28:25.565786 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:25.566858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:25.577407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.585141 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.587157 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.588790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.645155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-33e79a09-c007-471b-8b72-cab9d8c910d6 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments/038d92e7-84a9-49a6-bf5a-02307ef7915d" status: 202 len: 0 microversion: 2.1 time: 0.380369 Jan 26 19:28:25.647902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 273/540] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:28:25 2022] DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments/038d92e7-84a9-49a6-bf5a-02307ef7915d => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:25.656678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:25.658129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:25.665817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.667030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.668107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.668726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.739564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0d412e24-508f-4d9e-9f09-c01e701d924b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.176862 Jan 26 19:28:25.740762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 268/541] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:25 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:25.741062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6c3cb7ee-6023-4fcf-b0d0-85378b87bf9e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089668 Jan 26 19:28:25.742463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 274/542] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:28:25 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:25.755585 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:25.766896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:25.776483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:25.777234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:25.785998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.786767 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.796401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.797098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.818436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.818902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.820708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:25.822671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:25.925712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0588d280-bbe4-4b43-81b5-52c3042ffbd9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.176425 Jan 26 19:28:25.926802 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 269/543] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:25 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:26.101005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:26.114883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1ac99527-03d5-4ca5-b0d7-b4d78319a2e9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.354110 Jan 26 19:28:26.121582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 275/544] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:25 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:26.755794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:26.757968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:26.768203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:26.770101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:26.790248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.792194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.792899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:26.793965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.794777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:26.795464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:26.796543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.800103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:26.887892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7ff178d6-dcfb-429a-a6e9-99085a88d15a tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131549 Jan 26 19:28:26.887892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 276/545] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:28:26 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:26.912932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe43fe9c-b3d9-4518-8036-5120762f05a0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.160901 Jan 26 19:28:26.914132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 270/546] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:26 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:26.938920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:26.939849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:26.951009 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.951592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:26.952874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:26.953583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.076269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-67531913-778f-4384-bcf0-63daf15f5dcd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.140734 Jan 26 19:28:27.080908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 277/547] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:26 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:27.139343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:27.139989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:27.156516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.157319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.158316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.159093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.412739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:27.421103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1053e2d4-998e-42f5-afe7-661bd4917627 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.286881 Jan 26 19:28:27.422318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 271/548] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:27 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:27.694481 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-bef4ab92-47cb-4ec1-9d61-7544b311bc60 req-41e6bc13-dbc7-47ee-8c60-4d19028cbbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bff8c8-e41b-421a-bf67-a4538f83efbc", "name": "network-vif-plugged", "status": "completed", "tag": "710bf98d-993e-427e-8c77-bdda25d5f13d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:27.696461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:27.696461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:28:27.716043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-bef4ab92-47cb-4ec1-9d61-7544b311bc60 req-41e6bc13-dbc7-47ee-8c60-4d19028cbbda service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.719875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-bef4ab92-47cb-4ec1-9d61-7544b311bc60 req-41e6bc13-dbc7-47ee-8c60-4d19028cbbda service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.759982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-bef4ab92-47cb-4ec1-9d61-7544b311bc60 req-41e6bc13-dbc7-47ee-8c60-4d19028cbbda service nova] Creating event network-vif-plugged:710bf98d-993e-427e-8c77-bdda25d5f13d for instance 94bff8c8-e41b-421a-bf67-a4538f83efbc on hv-cinder-79400 Jan 26 19:28:27.770222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-bef4ab92-47cb-4ec1-9d61-7544b311bc60 req-41e6bc13-dbc7-47ee-8c60-4d19028cbbda service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078919 Jan 26 19:28:27.772034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 278/549] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:28:27.915081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:27.920168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:27.937981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.938869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.940227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:27.940491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.941276 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.946099 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:27.974886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.976845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.981065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:27.984461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:27.987248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dadc7f66-876b-48ee-808a-a1d2a78904ea tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093080 Jan 26 19:28:27.988537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 272/550] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:28:27 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:28:28.095404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9fa23477-7dba-4ecf-8415-51c4b5d0824a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.173704 Jan 26 19:28:28.096282 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 279/551] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:27 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:28.097399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:28.098475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:28.106611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:28.107069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:28.108388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:28.108826 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:28.439425 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:28.440978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:28.449229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:28.449849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:28.451057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:28.451584 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:28.543639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:28:28.544136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc (ip 10.222.0.50) !!! Jan 26 19:28:28.564634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-400258b7-2c10-49ca-86fd-163ec4b5c188 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.480274 Jan 26 19:28:28.565294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 273/552] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:28 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:28.804111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:28.820612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0efe335c-d5de-451f-a751-8266d96a5492 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.385242 Jan 26 19:28:28.821534 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 280/553] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:28 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:29.108606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:29.110441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:29.128762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.129510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.130489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.131075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.219578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c0032df1-bbef-4282-9257-429d2c9180b3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.116181 Jan 26 19:28:29.220503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 274/554] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:29 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:29.578931 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:29.580612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:29.597881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.599497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.601522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.601974 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.697919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-07c14aff-a0a6-491c-ad56-52acb5de079c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.123227 Jan 26 19:28:29.701968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 281/555] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:29 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:29.840508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:29.841491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:29.850463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.851291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.852319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:29.853053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:29.881941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:28:29.882439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc (ip 10.222.0.50) !!! Jan 26 19:28:30.067621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:30.079484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-758322a3-5dcc-4159-aef7-3d273bd09caf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1318 microversion: 2.1 time: 0.243466 Jan 26 19:28:30.090694 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 275/556] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:29 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:30.231633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:30.239757 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:30.266817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.267530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.268534 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.270482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.375107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a2fcc678-4408-483c-b900-9691004c9c1e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.148064 Jan 26 19:28:30.381144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 282/557] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:30 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:30.528835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:30.529389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:30.540799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.541816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.542617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.543021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.595321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:28:30.710565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:30.711668 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:30.727873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.729641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e18839be-2029-47a9-9178-a4f46fb8838f tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 204 len: 0 microversion: 2.1 time: 0.204055 Jan 26 19:28:30.729818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.730541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.732130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.733413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 276/558] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:28:30 2022] DELETE /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:28:30.752338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:30.754661 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:30.766237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.767087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.768266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:30.769088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:30.861058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9f8400a7-b246-43dd-8f4a-b8b2ec4c3a7e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.154648 Jan 26 19:28:30.865255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 283/559] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:30 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:30.952200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:30.959588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f4a4abf8-f2cd-4010-94fc-fa1c2684b192 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1507 microversion: 2.1 time: 0.221031 Jan 26 19:28:30.961487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 277/560] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:30 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:31.114730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:31.116412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:31.128158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.129582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.143411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.144985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.389612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:31.390717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:31.407032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.407488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.408574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.409006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.450012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:31.461338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-519e5851-deaa-4b96-a7ba-d1998733d283 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1507 microversion: 2.1 time: 0.352678 Jan 26 19:28:31.479516 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 284/561] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:31 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:31.502613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1a4603a2-04f6-401a-8b22-75b31097b7eb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.118888 Jan 26 19:28:31.504066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 278/562] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:31 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:31.876146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:31.877145 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:31.890837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.891300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.896600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.897136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.977218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:31.979027 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:31.992786 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.993501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:31.996272 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:31.996960 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:32.037098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f070483b-789d-4822-9f8c-bb0ef89aa526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.166580 Jan 26 19:28:32.041933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 285/563] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:31 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:32.221361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:32.232813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-32848668-75e2-4930-9584-2db0bec224d9 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1507 microversion: 2.1 time: 0.259373 Jan 26 19:28:32.238410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 279/564] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:31 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:32.518796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:32.520467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:32.532861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:32.533317 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:32.534107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:32.539368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:32.625583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1124c466-456c-454c-b277-e276f577beed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.112583 Jan 26 19:28:32.626326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 286/565] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:32 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:33.053449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:33.054396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:33.061125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.061574 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.062397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.062830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.139940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8e3667ae-1809-42d5-abb0-27edc29b6b1a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.094166 Jan 26 19:28:33.141073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 280/566] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:33 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:33.260355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:33.261079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:33.269498 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.270208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.271218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.271858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.625853 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:33.636535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4e3132bc-5e4c-47ef-9328-b805b62b68eb tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1507 microversion: 2.1 time: 0.384630 Jan 26 19:28:33.640093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 287/567] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:33 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:33.644547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:33.645819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:33.664609 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.665125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.666130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:33.666651 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:33.770956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-69da7df7-6beb-4199-9b95-f7f9e0d71b46 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.136113 Jan 26 19:28:33.779990 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 281/568] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:33 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:34.154195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:34.155489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:34.170528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.172253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.173243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.174803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.310237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bf6cad16-2175-41d1-89b0-dbd0c089a3fe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.159982 Jan 26 19:28:34.311655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 288/569] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:34 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:34.552990 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-00a66126-99a1-4e18-b815-510f3f102a65 req-f8d48606-9336-4640-91db-b8fb2b528937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91511721-4987-4610-a541-9b2aee7248eb", "name": "network-vif-deleted", "tag": "5caae4f3-a4db-4e20-a9d4-2446fc03ad58"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:34.559218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:34.559218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:28:34.577487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-00a66126-99a1-4e18-b815-510f3f102a65 req-f8d48606-9336-4640-91db-b8fb2b528937 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.578708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-00a66126-99a1-4e18-b815-510f3f102a65 req-f8d48606-9336-4640-91db-b8fb2b528937 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.607580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-00a66126-99a1-4e18-b815-510f3f102a65 req-f8d48606-9336-4640-91db-b8fb2b528937 service nova] Creating event network-vif-deleted:5caae4f3-a4db-4e20-a9d4-2446fc03ad58 for instance 91511721-4987-4610-a541-9b2aee7248eb on hv-cinder-79400 Jan 26 19:28:34.615329 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-00a66126-99a1-4e18-b815-510f3f102a65 req-f8d48606-9336-4640-91db-b8fb2b528937 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066421 Jan 26 19:28:34.617279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 282/570] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:34.656774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:34.658022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:34.667719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.672215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.673036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.673475 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.792486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:34.794330 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:34.803524 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.804319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.805637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:34.806395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:34.813406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:34.821436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e87b4d3a-a9f1-40b9-8d16-66286c00b721 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 200 len: 1292 microversion: 2.1 time: 0.168494 Jan 26 19:28:34.822841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 289/571] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:34 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 1292 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:34.881896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b35fb59f-4f69-498c-bb40-5e89730e12c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.093479 Jan 26 19:28:34.881896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 283/572] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:34 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:35.323363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:35.324485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:35.335580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.336058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.336883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.337809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.446553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4996f17d-6e7e-41e8-98b1-39fc82582554 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.128279 Jan 26 19:28:35.447369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 290/573] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:35 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:35.847981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:35.849396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: 91511721-4987-4610-a541-9b2aee7248eb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:35.860940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.861654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.862612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.863222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.898717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:35.899749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:35.904864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] HTTP exception thrown: Instance 91511721-4987-4610-a541-9b2aee7248eb could not be found. Jan 26 19:28:35.907812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Returning 404 to user: Instance 91511721-4987-4610-a541-9b2aee7248eb could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:28:35.908898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-030d959a-7df9-48a2-8098-4ca5f87042b2 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb" status: 404 len: 111 microversion: 2.1 time: 0.074037 Jan 26 19:28:35.912415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 284/574] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:35 2022] GET /compute/v2.1/servers/91511721-4987-4610-a541-9b2aee7248eb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:28:35.915813 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.916478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.918028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.920116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.922154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:35.922642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:35.939518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.939999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:35.940786 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:35.941219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:36.011599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:28:36.026205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9e4a5aac-0f29-4d02-87ca-ef14e303ce5f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.136301 Jan 26 19:28:36.027474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 291/575] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:35 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:36.201287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0f33fd27-e680-42f3-81f3-e0c851ad4849 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 204 len: 0 microversion: 2.1 time: 0.282552 Jan 26 19:28:36.201886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 285/576] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:28:35 2022] DELETE /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:28:36.210990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:36.212119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:36.226483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:36.227216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:36.228801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:36.229478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:36.459647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:36.461711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:36.474036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:36.475471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:36.476545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:36.477181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:36.488983 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:36.511483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-51c97c36-bb19-4006-ad12-fe7e9ca01d43 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.304222 Jan 26 19:28:36.512309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 292/577] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:36 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:36.568237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c99d1575-efa8-4f08-9b52-112acfee8d3f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.113091 Jan 26 19:28:36.569688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 286/578] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:36 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:37.038554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:37.039920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:37.055194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.055753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.056509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.056951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.222606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e7e2e397-0d89-49cb-9f2a-71cc30139a4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.182121 Jan 26 19:28:37.227349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 293/579] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:37 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:37.537779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:37.538469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:37.571797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.575488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.585857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:37.586906 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:37.595173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.597486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.622214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.623803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.629630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:37.631299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:37.834140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8675782-357e-4d33-b229-496744b9e017 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.256623 Jan 26 19:28:37.834944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 294/580] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:37 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:38.126445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:38.136244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-de49b14e-a9d0-47ae-9be8-91fdff8ea64d tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.605496 Jan 26 19:28:38.137740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 287/581] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:37 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:38.238446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:38.240998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:38.248177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:38.248628 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:38.249418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:38.249854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:38.490859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5faf38a3-7b60-40d4-a36f-c82cd11f0c7d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.256389 Jan 26 19:28:38.492820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 295/582] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:38 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:38.849354 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:38.851145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:38.861403 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:38.862227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:38.863952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:38.864570 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:39.001812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-974b2b4d-7a93-4161-8d61-ea1fc1a044f2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.158460 Jan 26 19:28:39.004838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 288/583] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:38 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:39.155970 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:39.156946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:39.164826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:39.165479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:39.166496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:39.167033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:39.342499 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:39.362357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-020704d5-ca20-4af7-b557-e03091065a86 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.210733 Jan 26 19:28:39.368196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 296/584] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:39 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:39.505728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:39.506901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:39.518181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:39.518635 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:39.519411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:39.519867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:39.624717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7ef04ff4-760a-48b7-944c-e3069c742794 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 28627 microversion: 2.1 time: 0.122209 Jan 26 19:28:39.628790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 289/585] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:39 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 28627 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:40.014324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:40.015269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:40.024511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.025009 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.025807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.026245 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.147919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-10e8d820-99d9-4668-8883-3bbed7a4c9c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 28684 microversion: 2.20 time: 0.131897 Jan 26 19:28:40.149136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 297/586] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:40 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 28684 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:40.379825 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:40.380499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:40.390844 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.391288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.392108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.392593 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.580075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:40.590783 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d2690997-31be-4054-904a-fda74c59bd16 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.215086 Jan 26 19:28:40.600208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 290/587] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:40 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:40.637937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:40.638906 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:40.656827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.657250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.658037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:40.658468 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:40.801325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5ca91ded-14d1-4259-a92b-7df8ef644dff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 29386 microversion: 2.1 time: 0.167753 Jan 26 19:28:40.803802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 298/588] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:40 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 29386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:41.160891 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:41.162876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:41.174373 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.175093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.176151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.176796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.310314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b436b6cb-66a6-4b57-8c53-44741799d712 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 29413 microversion: 2.20 time: 0.151871 Jan 26 19:28:41.311835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 291/589] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:41 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 29413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:41.609304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:41.609910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:41.622829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.623232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.626507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.632159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.816124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:41.817782 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:41.828046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.828461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.832919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:41.833559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:41.874074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:41.883177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b819376b-1e4f-40cc-b7cc-d15e285d1b27 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.277987 Jan 26 19:28:41.885195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 299/590] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:41 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:41.941309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe95858a-161e-48ca-a180-42d8a73bae4e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 30703 microversion: 2.1 time: 0.129575 Jan 26 19:28:41.942618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 292/591] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:41 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 30703 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:42.327805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:42.328984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:42.338115 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.338767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:42.340100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.340816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:42.484340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-040a43d9-d13a-46d9-9e0a-3df910cd9457 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 30493 microversion: 2.20 time: 0.165537 Jan 26 19:28:42.485407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 300/592] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:42 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 30493 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:42.901285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:42.901987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:42.919824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.920285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:42.921088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.921520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:42.953419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:42.954441 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:42.968183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.968639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:42.969431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:42.969867 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:43.075405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a92993c3-fa65-49d7-978a-810f7470512d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 31683 microversion: 2.1 time: 0.125778 Jan 26 19:28:43.076447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 301/593] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:42 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 31683 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:43.273994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:43.285814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-44712f51-490a-4db4-a7cb-bc9d7b023b5e tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1522 microversion: 2.1 time: 0.384992 Jan 26 19:28:43.286823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 293/594] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:42 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:43.502743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:43.503756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:43.519401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:43.519904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:43.520816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:43.521548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:43.654262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dd0c15e7-cccd-4a6f-8be8-4be0ade943cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 31567 microversion: 2.20 time: 0.161644 Jan 26 19:28:43.654920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 302/595] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:43 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 31567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:43.850596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-a67a2d63-bf30-43c6-be54-1561094295f1 req-efbdb1e2-b57f-412a-9f8b-eebf9a663b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d757f9bf-0099-40a5-aa9d-9c174a3ac859", "name": "network-vif-deleted", "tag": "1b7adc2f-208b-4133-b88e-b377af0b7104"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:43.855401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:28:43.855401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:28:43.871021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a67a2d63-bf30-43c6-be54-1561094295f1 req-efbdb1e2-b57f-412a-9f8b-eebf9a663b2a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:43.871837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a67a2d63-bf30-43c6-be54-1561094295f1 req-efbdb1e2-b57f-412a-9f8b-eebf9a663b2a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:43.890299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-a67a2d63-bf30-43c6-be54-1561094295f1 req-efbdb1e2-b57f-412a-9f8b-eebf9a663b2a service nova] Creating event network-vif-deleted:1b7adc2f-208b-4133-b88e-b377af0b7104 for instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 on hv-cinder-79400 Jan 26 19:28:43.895538 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-a67a2d63-bf30-43c6-be54-1561094295f1 req-efbdb1e2-b57f-412a-9f8b-eebf9a663b2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054581 Jan 26 19:28:43.896755 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 294/596] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:44.087076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:44.088656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:44.095285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.095736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.096536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.097186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.179617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8ab6ff01-851c-4600-9bf5-10b6d3cc3c44 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 32880 microversion: 2.1 time: 0.096293 Jan 26 19:28:44.180895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 303/597] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:44 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 32880 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:44.311164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:44.311960 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:44.327747 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.328239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.329040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.329474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.399084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.401168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.402492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lazy-loading 'fault' on Instance uuid d757f9bf-0099-40a5-aa9d-9c174a3ac859 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:28:44.516575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6484f0bf99384bf2b80c3cffb9f9ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93424b38a7474b9787347d46184008c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:44.530154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-94e40ef6-3f83-4ade-a94e-be5c71e08552 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 200 len: 1312 microversion: 2.1 time: 0.230712 Jan 26 19:28:44.532171 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 295/598] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:44 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:44.667052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:44.668523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:44.677557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.678368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.679403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:44.680261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:44.768012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-40eb0e15-fe4b-442c-af35-1f2e885c07b8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 32486 microversion: 2.20 time: 0.105151 Jan 26 19:28:44.768723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 304/599] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:44 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 32486 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:45.191628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:45.192905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:45.201344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.203373 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.206319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.206919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.315857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-df07f735-f0b4-4c42-80ee-3b2f603eab9a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 33449 microversion: 2.1 time: 0.127537 Jan 26 19:28:45.319905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 296/600] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:45 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 33449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:45.550181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:45.551566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] [instance: d757f9bf-0099-40a5-aa9d-9c174a3ac859] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:45.561654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.564292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.565807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.566918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.595266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] HTTP exception thrown: Instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 could not be found. Jan 26 19:28:45.595491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] Returning 404 to user: Instance d757f9bf-0099-40a5-aa9d-9c174a3ac859 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:28:45.597795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0e97ad6a-bb38-40dc-9196-77fbd8f0f1a1 tempest-ServerRescueNegativeTestJSON-584995975 tempest-ServerRescueNegativeTestJSON-584995975-project] 10.222.0.50 "GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859" status: 404 len: 111 microversion: 2.1 time: 0.053383 Jan 26 19:28:45.601670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 305/601] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:45 2022] GET /compute/v2.1/servers/d757f9bf-0099-40a5-aa9d-9c174a3ac859 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:28:45.782096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:45.784175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:45.821449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.822951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.827455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:45.829802 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:45.943759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-06277740-0f3f-4b62-8e77-033cedfd84ac tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 33300 microversion: 2.20 time: 0.166719 Jan 26 19:28:45.945409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 297/602] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:45 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 33300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:46.330384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:46.331300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:46.343877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:46.345573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:46.350312 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:46.351013 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:46.476560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3ae8a509-482d-4a90-85c8-8e9fc8965ccd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 34362 microversion: 2.1 time: 0.150148 Jan 26 19:28:46.479128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 306/603] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:46 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 34362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:46.960169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:46.961788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:46.973515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:46.980442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:46.981575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:46.982012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:47.100545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-611fc756-5714-45fd-9576-bed2ce878a4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 34141 microversion: 2.20 time: 0.144306 Jan 26 19:28:47.101897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 298/604] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:46 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 34141 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:47.508560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:47.510646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:47.520397 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:47.521216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:47.522205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:47.522900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:47.685469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-740acde5-2cdc-4973-9fce-d5f18e011ebc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 35010 microversion: 2.1 time: 0.192403 Jan 26 19:28:47.689932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 307/605] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:47 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 35010 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:48.113242 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:48.114411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:48.131354 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:48.135348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:48.137861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:48.148887 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:48.308123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4ebad2e6-537f-4a7d-aa85-c590d3ea1ced tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 35163 microversion: 2.20 time: 0.196668 Jan 26 19:28:48.308830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 299/606] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:48 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 35163 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:48.700219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:48.701980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:48.714533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:48.716758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:48.720033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:48.720950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:48.859093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d1e8d2c4-38bc-4400-8eb0-52b6f4e890e8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 36122 microversion: 2.1 time: 0.164833 Jan 26 19:28:48.860443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 308/607] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:48 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 36122 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:49.321621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:49.322956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:49.349202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:49.354492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:49.355731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:49.356550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:49.508161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-62630e85-755d-4560-a8ed-42c57c3be60d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 36485 microversion: 2.20 time: 0.182484 Jan 26 19:28:49.517919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 300/608] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:49 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 36485 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:49.871895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:49.873457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:49.882847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:49.886006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:49.887138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:49.889291 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:49.987389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-86c717f5-8e34-4a62-9194-e1166f1ac31e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 37398 microversion: 2.1 time: 0.119179 Jan 26 19:28:49.988649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 309/609] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:49 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 37398 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:50.531158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:50.532196 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:50.548423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:50.548423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:50.549239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:50.552962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:50.667281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-756d03b9-b0a4-49e9-a44e-ea7a291e229e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 37745 microversion: 2.20 time: 0.140598 Jan 26 19:28:50.668149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 301/610] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:50 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 37745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:51.000440 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:51.008087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:51.027470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:51.028507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:51.030782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:51.032280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:51.154547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e28a314b-ae40-41f0-8fcd-cfe045c56301 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 38147 microversion: 2.1 time: 0.158379 Jan 26 19:28:51.158624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 310/611] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:50 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 38147 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:28:51.679225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:51.680249 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:51.690201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:51.695890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:51.704003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:51.704696 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:51.842812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1dfc0535-82c8-4882-ad05-e0c643849395 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 38223 microversion: 2.20 time: 0.167146 Jan 26 19:28:51.844724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 302/612] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:51 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 38223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:52.167689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:52.169569 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:52.183658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:52.187682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:52.188759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:52.189404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:52.278642 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2ba37c4e-dd21-4379-84ce-84e2c19c2128 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 38147 microversion: 2.1 time: 0.115666 Jan 26 19:28:52.279445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 311/613] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:52 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 38147 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:52.861865 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:52.863943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:52.891567 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:52.893471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:52.894484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:52.896415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:52.990664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a4a33f89-7d3f-4de5-a88b-8174898011cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 38223 microversion: 2.20 time: 0.136565 Jan 26 19:28:52.991757 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 303/614] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:52 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 38223 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:53.291391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:53.293108 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:53.303646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:53.307674 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:53.311638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:53.312327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:53.443594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-32960c3b-c01a-43ad-aae8-55e066dea6ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 38147 microversion: 2.1 time: 0.156386 Jan 26 19:28:53.444730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 312/615] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:53 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 38147 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:53.817422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'create', calling method: .version_select at 0x7fb7c0ef6040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1778080386"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:53.841728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:28:53.846343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for user 1acda2aff34d43cea680c21af6aa2053 and project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:28:54.005049 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:54.006044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:54.017407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.019789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.022952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.024045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.133079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:28:54.141436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-afffb108-0ea7-4f7c-bd7f-67ca28b74de7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 38223 microversion: 2.20 time: 0.141052 Jan 26 19:28:54.143251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 313/616] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:53 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 38223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:28:54.150769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for user 1acda2aff34d43cea680c21af6aa2053 and project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:28:54.190138 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-76131122-dacc-4379-825a-4791a95cc72f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.385771 Jan 26 19:28:54.193422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 304/617] 10.222.0.50 () {60 vars in 1157 bytes} [Wed Jan 26 19:28:53 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:54.355743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1736674381", "imageRef": "56cb2c82-55e3-4fb9-b6eb-90fcb2b00ea1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1778080386", "networks": [{"uuid": "590152ee-adf6-40f5-834e-49c3cbd5a7a8"}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:54.446533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] validate_networks() for [('590152ee-adf6-40f5-834e-49c3cbd5a7a8', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:28:54.455608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:54.456610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:54.470158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.470985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.471917 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.472363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.580240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0148e316-9272-44e4-b88b-428ae10c9074 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 200 len: 38276 microversion: 2.1 time: 0.128320 Jan 26 19:28:54.581290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 305/618] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:28:54 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 38276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:54.592983 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:54.593769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:54.611814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.612263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.613057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.613487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.669077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f86df2ae-3af3-432a-b6c6-364e55aecadd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/ips" status: 200 len: 147 microversion: 2.1 time: 0.080435 Jan 26 19:28:54.670333 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 306/619] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:28:54 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/ips => generated 147 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:28:54.979135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:28:54.979561 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:28:54.980054 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:28:54.980457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:28:54.980864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:28:54.991979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.992775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:54.994521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:54.995170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:55.025835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:28:55.037762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Getting quotas for user 1acda2aff34d43cea680c21af6aa2053 and project 40e0cd503f8d4553bd7dad0615823d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:28:55.056752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:28:55.059404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='56cb2c82-55e3-4fb9-b6eb-90fcb2b00ea1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:28:55.126538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d79267c4-9091-4359-971a-9aa616b76c45 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776566 Jan 26 19:28:55.128012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 314/620] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:28:55.139994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4c94f069-6244-4629-b971-13f9e7842645 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:55.141854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4c94f069-6244-4629-b971-13f9e7842645 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:55.154734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:55.164412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:55.179260 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:55.182444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:55.184875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:55.187797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:55.287078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4c94f069-6244-4629-b971-13f9e7842645 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:55.293351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cb22e168-3a99-413a-9215-9bbeb54cfef7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 200 len: 38366 microversion: 2.20 time: 0.142111 Jan 26 19:28:55.297249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 315/621] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:28:55 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 38366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:28:55.303863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4c94f069-6244-4629-b971-13f9e7842645 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1259 microversion: 2.1 time: 0.169779 Jan 26 19:28:55.304046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:55.304766 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:55.313682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:55.314194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:55.315109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:55.320411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:55.329807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 307/622] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:55 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:55.439713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a704fbb-87a0-43a1-84dd-2ea5bbab83d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/ips" status: 200 len: 150 microversion: 2.20 time: 0.139224 Jan 26 19:28:55.441473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 316/623] 10.222.0.50 () {60 vars in 1288 bytes} [Wed Jan 26 19:28:55 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:28:56.098734 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d777d6-4d73-44cf-8d32-f23c85bc8a68", "device": "/dev/sdb"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:56.100376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:56.115134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:56.115621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:56.116765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:56.117200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:56.338436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:56.339587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:56.382017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:56.384416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:56.385422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:56.389161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:56.535389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:56.544283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a2fd659e-35da-4800-8c45-cd3e5756ecbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1311 microversion: 2.1 time: 0.224102 Jan 26 19:28:56.544762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 317/624] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:56 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:56.810071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-718a7fd2-4ca2-4d6a-b55a-510ee0456f37 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "POST /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715815 Jan 26 19:28:56.812647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 308/625] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:28:56 2022] POST /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:28:57.561180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:57.561794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:57.575014 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:57.578349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:57.580091 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:57.582180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:57.695806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:57.705847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-28defe82-e8cc-413b-b6d1-27a4eb425ac7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1317 microversion: 2.1 time: 0.148038 Jan 26 19:28:57.707564 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 318/626] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:57 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:28:58.476311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95233061-87a0-40d0-9d4c-fee09d5cb895"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:28:58.478221 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:58.498084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:58.498682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:58.499702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:58.500693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:58.723880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:28:58.724769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:28:58.738037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:58.738811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:58.739834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:28:58.740431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:28:58.954562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:28:58.963179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bb0bd9b3-ce4a-49a2-96b9-73ce01257a2b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.242987 Jan 26 19:28:58.964134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 319/627] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:28:58 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:00.187657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Action: 'create', calling method: .version_select at 0x7fb7c0e3eee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1418193573"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:00.202407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for project 84d90c74a445407ab6459be30826b3f7. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:29:00.206408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for user ac82831a8435454aae7a7669764bb8a9 and project 84d90c74a445407ab6459be30826b3f7. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:29:00.502616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for project 84d90c74a445407ab6459be30826b3f7. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:29:00.507304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for user ac82831a8435454aae7a7669764bb8a9 and project 84d90c74a445407ab6459be30826b3f7. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:29:00.520929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ed6324a5-9df8-4b69-828a-915702e13267 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.565118 Jan 26 19:29:00.521517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 320/628] 10.222.0.50 () {60 vars in 1157 bytes} [Wed Jan 26 19:28:59 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:00.526459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:00.527312 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:00.533086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:00.533528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:00.534294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:00.534722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:00.682185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:00.689530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7301aecb-a6d2-4b80-940e-684b5a4a9431 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.166909 Jan 26 19:29:00.690186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 321/629] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:00 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:01.710910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:01.711552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:01.721510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:01.721968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:01.722773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:01.724265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:01.964293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:01.972785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dcc4e083-aff7-426f-b506-ba805f13c571 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.267729 Jan 26 19:29:01.984389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 322/630] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:01 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:02.990773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:02.991487 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:02.997999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:02.998576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:02.999398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:02.999858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:03.161008 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:03.168947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f997c430-2608-45ba-8b46-3e8f1cc56d0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.181991 Jan 26 19:29:03.170675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 323/631] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:02 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:04.187513 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:04.188188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:04.197023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:04.197466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:04.198244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:04.198709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:04.374673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:04.382524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-84c514d9-afb1-4a0c-a871-e30f55169d37 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.199450 Jan 26 19:29:04.383112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 324/632] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:04 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:05.400512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:05.401122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:05.407440 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:05.407926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:05.408699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:05.409130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:05.592917 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:05.608208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-58a33c30-8e45-48fd-b68e-f8b447c91a75 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.212358 Jan 26 19:29:05.609252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 325/633] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:05 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:05.624796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:05.625445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:05.639396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:05.640209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:05.641450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:05.642052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:05.676935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lazy-loading 'flavor' on Instance uuid a15ff6ad-b011-48d9-a8af-fc836715e6f5 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:29:11.859838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-38817f46-a47f-48fb-8c38-f4323a358912 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 202 len: 0 microversion: 2.20 time: 6.246754 Jan 26 19:29:11.862749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 326/634] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:29:05 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 0 bytes in 6248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:29:11.865313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:11.865999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:11.872539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:11.872984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:11.873756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:11.874196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:12.007984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:12.015271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-06a88242-4aeb-4c95-8907-138ee02deda5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.153752 Jan 26 19:29:12.015950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 327/635] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:11 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:12.020092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:12.020681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:12.027146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:12.027586 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:12.028398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:12.028836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:12.164404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:12.172370 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:12.173879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:12.175032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c401241f-9f71-4d4a-9b72-4c38c62bc7b0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.158204 Jan 26 19:29:12.175587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 328/636] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:12 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:13.032490 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:13.033146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:13.039798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:13.040264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:13.041033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:13.041464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:13.168026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:13.175211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9e445f04-7dce-4a90-a0be-8cd5d3d1572a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.146410 Jan 26 19:29:13.175792 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 329/637] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:13 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:13.192701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:13.193293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:13.198753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:13.199202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:13.200006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:13.200445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:13.326988 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:13.334666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:13.336696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:13.337828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3335f584-a6b0-412b-8358-7db42337641a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.148504 Jan 26 19:29:13.338387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 330/638] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:13 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:29:14.192251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:14.192935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:14.199705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:14.200170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:14.200939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:14.201372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:14.331986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:14.339396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6795d819-2012-49a5-93f4-2f61b22957f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.150844 Jan 26 19:29:14.339994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 331/639] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:14 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:14.355733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:14.356358 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:14.364185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:14.364633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:14.365404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:14.365843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:14.521452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:14.529568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:14.531062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:14.532233 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b83bfea7-a7f8-4e5c-8e6f-f726a5416461 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.180515 Jan 26 19:29:14.532887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 332/640] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:14 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:29:14.681366 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ef750da-d9bd-49ea-bbbd-5f0f1faf24b2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.209894 Jan 26 19:29:14.690544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 309/641] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:28:58 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments => generated 194 bytes in 16220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:29:15.356051 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:15.357294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:15.363909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:15.364365 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:15.365149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:15.365588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:15.511518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:15.520285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-58e9273e-15ab-4dcf-a82c-348c2c277691 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.168368 Jan 26 19:29:15.521147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 333/642] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:15 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:15.551182 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:15.551902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:15.558216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:15.558672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:15.559445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:15.559914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:15.625598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-d484e070-22bb-43d0-85a8-fbd2a0454fc3 req-2a2e01fa-77e2-46a2-81eb-a06d0d12f039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:15.628021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:29:15.628021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:29:15.645297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-d484e070-22bb-43d0-85a8-fbd2a0454fc3 req-2a2e01fa-77e2-46a2-81eb-a06d0d12f039 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:15.646179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-d484e070-22bb-43d0-85a8-fbd2a0454fc3 req-2a2e01fa-77e2-46a2-81eb-a06d0d12f039 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:15.661305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-d484e070-22bb-43d0-85a8-fbd2a0454fc3 req-2a2e01fa-77e2-46a2-81eb-a06d0d12f039 service nova] Creating event network-changed:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:29:15.667087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-d484e070-22bb-43d0-85a8-fbd2a0454fc3 req-2a2e01fa-77e2-46a2-81eb-a06d0d12f039 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045555 Jan 26 19:29:15.667721 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 334/643] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:29:15.943388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:15.966367 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:15.968065 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:15.969467 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a60f77e-1b7c-4b43-9437-c6bdb08270b3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.422761 Jan 26 19:29:15.977797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 310/644] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:15 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:16.544533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:16.545347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:16.551441 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:16.552004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:16.552851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:16.553286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:16.726004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:16.735057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b55bb01c-0e95-4178-836d-2b7f78e1a224 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.199067 Jan 26 19:29:16.735641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 335/645] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:16 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:16.988151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:16.988750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:16.996769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:16.997216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:16.997986 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:16.998609 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:17.133924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:17.147402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:17.150723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:17.152610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-59264692-f1f5-4400-b8b2-6031c7eca9cb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.168630 Jan 26 19:29:17.153201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 311/646] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:16 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:17.752134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:17.752761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:17.758864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:17.759963 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:17.760790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:17.761223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:17.895119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:17.903076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-596f812f-2010-453c-8d48-6e0a1606a531 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.154437 Jan 26 19:29:17.903710 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 336/647] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:17 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:18.170915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:18.171506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:18.177656 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:18.178100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:18.178863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:18.179292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:18.305725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:18.314398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:18.315988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:18.317311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a59cc76-6704-4bc1-a0a4-c8ef7cb5f3e6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.150006 Jan 26 19:29:18.317970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 312/648] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:18 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:18.918872 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:18.919483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:18.925679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:18.926132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:18.926912 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:18.927348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:19.068860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:19.079152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3d15c62c-2553-49fd-a943-44c01f4c13eb tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.163934 Jan 26 19:29:19.083843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 337/649] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:18 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:19.335081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:19.335675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:19.341868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:19.342301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:19.343062 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:19.343483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:19.478797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:19.486607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:19.488156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:19.489318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-688c7b18-0764-417e-b111-fc372755fc41 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.157904 Jan 26 19:29:19.489889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 313/650] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:19 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:20.100619 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:20.101226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:20.107651 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:20.108534 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:20.109505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:20.110106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:20.246292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:20.253558 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e51e0f6e-b0d1-4ed5-b32d-374fee9b0c18 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.157230 Jan 26 19:29:20.254120 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 338/651] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:20 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:20.507499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:20.508151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:20.514933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:20.515380 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:20.516180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:20.516612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:20.643070 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:20.651622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:20.653136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:20.654275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a2d4db09-f73e-4556-8996-66f3571eb3d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.150458 Jan 26 19:29:20.654828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 314/652] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:20 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:21.269668 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:21.270264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:21.276734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:21.277175 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:21.277938 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:21.278367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:21.401598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:21.408738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ca04ba41-f099-4fa7-a3be-ec1336b2742d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.142707 Jan 26 19:29:21.409293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 339/653] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:21 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:21.672484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:21.672995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:21.679161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:21.679607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:21.680410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:21.680836 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:21.805012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:21.812818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:21.814309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:21.815441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c1852b63-ed1d-4872-9d8d-eb1192a6d8c8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.146806 Jan 26 19:29:21.816035 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 315/654] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:21 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:22.425541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:22.426125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:22.432861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:22.433304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:22.434066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:22.434491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:22.560745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:22.567809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-461867ee-0ab0-4b59-bd8e-4f4d08621cc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.145861 Jan 26 19:29:22.568366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 340/655] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:22 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:22.838203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:22.838811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:22.845051 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:22.845513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:22.846338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:22.846713 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:22.974103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:22.982395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:22.983909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:22.985048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-935f033c-2957-46d4-8d35-0d3216d34fe2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.150490 Jan 26 19:29:22.985611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 316/656] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:22 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:23.583596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:23.584261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:23.590989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:23.591430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:23.592223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:23.592652 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:23.716050 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:23.723134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-01ecfcab-6e75-481c-9d0f-02fc149199c1 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.143098 Jan 26 19:29:23.723690 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 341/657] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:23 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:24.003442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:24.003998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:24.010833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:24.011277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:24.012084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:24.012520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:24.135347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:24.143238 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:24.144758 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:24.145894 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f3152e9a-dcaf-4fdd-b419-fe0967af8bb3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.146156 Jan 26 19:29:24.146442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 317/658] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:23 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:24.739316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:24.739945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:24.746211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:24.746652 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:24.747411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:24.747871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:24.878934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:24.886601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-592d013b-e63d-4271-9c7d-d66c3ccd62a2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.150996 Jan 26 19:29:24.887159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 342/659] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:24 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:25.162901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:25.163554 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:25.170050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:25.170494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:25.171271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:25.171702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:25.294910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:25.302689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:25.304230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:25.305374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1c41761b-7d65-4f49-b0c7-cb9f6b848fee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.146136 Jan 26 19:29:25.306415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 318/660] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:25 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:25.903739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:25.904372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:25.910881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:25.911325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:25.912246 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:25.912678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:26.039396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:26.047222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2479b79b-d58c-4baa-82f8-57950a91f03a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.147553 Jan 26 19:29:26.047809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 343/661] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:25 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:26.323611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:26.324232 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:26.330491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:26.330936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:26.331708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:26.332165 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:26.463478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:26.471373 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:26.472982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:26.474179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0e0ba4fd-905f-430a-9fca-369832e380d1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.154754 Jan 26 19:29:26.474734 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 319/662] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:26 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:27.064026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:27.064708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:27.070509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.070958 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.071725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.072181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.197844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:27.205087 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-065c3ac1-2bb4-4a09-9e92-47608eb8a399 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.144865 Jan 26 19:29:27.205666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 344/663] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:27 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:27.493837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:27.494431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:27.500504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.500943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.501709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.502137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.539022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f8e8c7c9-96b4-471f-b079-47552b58fe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:27.545553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8e8c7c9-96b4-471f-b079-47552b58fe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.545997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8e8c7c9-96b4-471f-b079-47552b58fe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.604735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f8e8c7c9-96b4-471f-b079-47552b58fe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Going to try to stop instance {{(pid=116106) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 26 19:29:27.632392 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:27.640236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:27.641748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:27.643070 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bc0d43c5-779e-4882-84eb-db18416b5dab tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.152811 Jan 26 19:29:27.643907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 320/664] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:27 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:27.645462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f8e8c7c9-96b4-471f-b079-47552b58fe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 202 len: 0 microversion: 2.1 time: 0.109979 Jan 26 19:29:27.646032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 345/665] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:29:27 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:29:27.658850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:27.659445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:27.666322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.666775 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.667552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:27.668023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:27.795660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:27.803497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ec036366-07eb-41a1-92c0-4b3742bc05ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.148168 Jan 26 19:29:27.804147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 321/666] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:27 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:28.223580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:28.224507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:28.231525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.232682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.233672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.234121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.362676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:28.370670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-245bb5e1-0263-46bd-9bb7-fc2e0c8a7aff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.152801 Jan 26 19:29:28.371239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 346/667] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:28 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:28.661522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:28.662045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:28.668729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.669175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.669951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.670382 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.793292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:28.800895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:28.802444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:28.803697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f89d37c-591c-4627-ac22-0363aa5ea969 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.145883 Jan 26 19:29:28.804279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 322/668] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:28 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:28.821171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:28.822383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:28.827918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.828527 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.829302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:28.829732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:28.953362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:28.960959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-609ec185-5e79-4c14-8107-b1844f670172 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.143589 Jan 26 19:29:28.961520 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 347/669] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:28 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:29.386620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:29.387223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:29.393057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.393499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:29.394260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.394686 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:29.520575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:29.528659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-810c65cf-d900-4e4f-bf16-3022ed29075f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.146114 Jan 26 19:29:29.529160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 323/670] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:29 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:29.825283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:29.825814 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:29.832101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.832544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:29.833759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.833759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:29.962191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:29.969891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:29.971375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:29.972543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b379cdad-a308-463f-bb41-9b33ca841445 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.151677 Jan 26 19:29:29.973106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 348/671] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:29 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:29.978013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:29.978616 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:29.984812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.985259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:29.986039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:29.986474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:30.116160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:30.124573 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d95b23c6-41dc-4297-96ec-403ddb700f95 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.150134 Jan 26 19:29:30.125143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 324/672] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:29 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:30.545439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:30.545942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:30.551555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:30.552026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:30.552786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:30.553211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:30.675997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:30.683045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9906beea-44df-483c-83cb-9550e63c20b8 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.141212 Jan 26 19:29:30.683597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 349/673] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:30 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:30.989880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:30.990440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:30.996682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:30.997132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:30.997912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:30.998344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:31.121212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:31.128797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:31.130268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:31.131398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c843c372-1f36-4715-a92d-bd8aee70b8f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.145401 Jan 26 19:29:31.131976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 325/674] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:30 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:31.140334 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:31.140939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:31.147057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:31.147509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:31.148574 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:31.149006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:31.273574 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:31.281205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-74f6f389-88ac-446e-93aa-ac2de47cbe98 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.144519 Jan 26 19:29:31.281768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 350/675] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:31 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:31.699436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:31.700090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:31.705956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:31.706400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:31.707166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:31.707599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:31.833456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:31.840680 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d23d29f4-5c8c-4626-8fd1-cc16085c3f1b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.144871 Jan 26 19:29:31.841251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 326/676] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:31 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:32.149179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:32.150203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:32.156393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.156836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.157594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.158024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.282268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:32.290493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:32.292009 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:32.293145 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e334ddc3-b2f5-4a0c-8500-137140a3bac9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.148043 Jan 26 19:29:32.293692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 351/677] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:32 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:32.298075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:32.298672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:32.304861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.305299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.306087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.306510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.438659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:32.447426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-21392050-fc2e-438e-978c-539d189d1293 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.153033 Jan 26 19:29:32.448021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 327/678] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:32 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:32.857401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:32.858019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:32.863649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.864116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.864887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:32.865300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:32.988629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:32.996482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a2b3bce-8d6e-4c68-b4d6-52b545047c8f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.142993 Jan 26 19:29:32.997053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 352/679] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:32 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:33.311611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:33.312251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:33.318527 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:33.318975 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:33.319748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:33.320214 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:33.452656 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:33.460545 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:33.462797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:33.464040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8e14d1c2-416a-41a8-a838-97a661fde753 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.156129 Jan 26 19:29:33.464768 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 328/680] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:33 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:33.465322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:33.465940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:33.472016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:33.472470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:33.473245 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:33.473933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:33.606369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:33.614082 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e2ac58ee-846b-48b5-9c24-916a564db6f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.153369 Jan 26 19:29:33.614651 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 353/681] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:33 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:34.013319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:34.013939 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:34.019996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.020450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.021229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.021663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.146379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:34.154514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac86a8c0-943a-429b-86fb-31afea1093e2 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.144859 Jan 26 19:29:34.155075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 329/682] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:34 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:34.481656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:34.482242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:34.488454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.488898 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.489662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.490091 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.613581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:34.621820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:34.623324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:34.624528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7a383c48-55a1-4b29-a582-71234a3b6fe9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.146541 Jan 26 19:29:34.625190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 354/683] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:34 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:34.630127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:34.630815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:34.637045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.637514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.638284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:34.638713 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:34.766701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:34.774683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0eee9046-0978-4966-b3c1-314f9642aac3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.148179 Jan 26 19:29:34.775270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 330/684] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:34 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:35.170773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:35.171369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:35.177314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.177759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.178522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.178953 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.303540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:35.310832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b8c250c5-5028-458c-93b5-c79ceaaf6fcd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.143729 Jan 26 19:29:35.311403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 355/685] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:35 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:35.642353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:35.643167 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:35.650087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.650528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.651299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.651730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.786265 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:35.791892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:35.792593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:35.799531 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.800053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.801025 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:35.801461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:35.807909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:35.809564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:35.810619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3456656c-6fff-4276-b39e-bacec2f56c24 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.172078 Jan 26 19:29:35.811174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 331/686] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:35 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:35.929784 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:35.937977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dbe6add9-5328-48a6-9a78-7ef833a4e5ed tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.150090 Jan 26 19:29:35.938540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 356/687] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:35 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:36.327261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:36.327893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:36.333648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.334102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.334841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.335265 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.460524 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:36.468160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d67a67e5-8f60-41aa-bd60-f82898709160 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.144463 Jan 26 19:29:36.468701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 332/688] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:36 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:36.829169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:36.829869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:36.835958 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.836421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.838183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.838951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.955089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:36.955735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:36.962640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.963089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.963969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:36.964409 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:36.967741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:36.975515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:36.977132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:36.978347 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f66b0301-5555-46fb-9d1e-374c7cf480e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.152930 Jan 26 19:29:36.978985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 357/689] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:36 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:37.091191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:37.098993 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-915e385b-2276-48d3-9221-0a31760d1346 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.147508 Jan 26 19:29:37.099562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 333/690] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:36 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:37.485226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:37.485860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:37.491640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:37.492118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:37.493399 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:37.493827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:37.615076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:37.622711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7f8dec56-d636-4253-a00f-ae40bfb9ea9b tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.141074 Jan 26 19:29:37.623270 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 358/691] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:37 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:37.996710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:37.997349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:38.003553 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.004050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.004829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.005264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.115583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:38.116224 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:38.122499 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.122893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.123703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.124188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.129954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:38.137684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:38.139201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:38.140357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65cc8b88-6041-4487-b0ba-5b4cc56a07bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.147534 Jan 26 19:29:38.140905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 334/692] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:37 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:38.248807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:38.256566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f7f9a887-1bfb-479c-828b-b52eac99c83a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.144640 Jan 26 19:29:38.257136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 359/693] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:38 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:38.639614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:38.640364 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:38.647818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.648801 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.650268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:38.650703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:38.776546 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:38.783882 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-15012a8d-bed5-412f-8cd4-fd50676d36f9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.148236 Jan 26 19:29:38.784449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 335/694] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:38 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:39.158810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:39.159316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:39.165996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.166437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.167200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.167629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.273440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:39.274102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:39.280253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.280701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.281478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.281916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.294723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:39.302480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:39.303983 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:39.305141 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c9ee5ef9-befe-4dbc-a57f-708c68caa1da tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.150133 Jan 26 19:29:39.306357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 360/695] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:39 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:39.410560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:39.419083 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-25359697-4ed2-4f96-8ccd-ee92b4939e85 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.149519 Jan 26 19:29:39.419656 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 336/696] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:39 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:39.799989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:39.800623 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:39.806445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.806885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.807649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:39.808103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:39.930376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:39.937960 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-13e599e3-7414-4369-8578-cedbea3426aa tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.141532 Jan 26 19:29:39.938516 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 361/697] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:39 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:40.324653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:40.325252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:40.331471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.331965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:40.332743 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.333170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:40.436100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:40.436704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:40.443010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.443454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:40.444252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.444679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:40.462610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:40.470286 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:40.471762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:40.472950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-92afe554-4193-44fd-beb8-5c7cbe27b4d5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.152647 Jan 26 19:29:40.473539 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 337/698] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:40 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:40.571556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:40.579154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d037fdec-0251-45be-85f8-f6d8c3a005c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.146659 Jan 26 19:29:40.579712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 362/699] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:40 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:40.954226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:40.954822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:40.960682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.961122 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:40.962371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:40.962796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:41.097206 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:41.105658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8b7e33c9-76ac-4d3c-b68b-073fe9753f80 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.154946 Jan 26 19:29:41.106259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 338/700] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:40 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:41.490197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:41.490795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:41.497243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:41.497695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:41.498475 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:41.498945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:41.595599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:41.596225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:41.602431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:41.602937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:41.603720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:41.604359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:41.623133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:41.630758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:41.632286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:41.633959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a0b2dadf-91a1-46f2-8fee-19ec00a9035f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.146955 Jan 26 19:29:41.634521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 363/701] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:41 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:41.730282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:41.738351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f1b07d36-8639-4a71-9db7-edb5ac67d2ac tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.146269 Jan 26 19:29:41.738921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 339/702] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:41 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:42.122305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:42.122899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:42.128767 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.129205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.129965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.130400 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.253526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:42.260689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6d479b44-70ae-49ae-adb7-1bf9c94ee548 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.142570 Jan 26 19:29:42.261244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 364/703] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:42 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:42.652661 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:42.653291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:42.659529 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.660011 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.660782 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.661209 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.758944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:42.760160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:42.766353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.766873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.767706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:42.768250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:42.791311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:42.799987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:42.801496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:42.803019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-afab8c48-117b-4c1a-8d8d-f66257e410af tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.154569 Jan 26 19:29:42.804119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 340/704] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:42 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:42.899530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:42.908186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ae6b4cfd-0943-4a70-9ac6-1627f8daec2b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.152774 Jan 26 19:29:42.908679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 365/705] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:42 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:43.277125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:43.277729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:43.283504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.283994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.284764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.285191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.406943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:43.414106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-784b67c5-d6c2-4364-a184-8fcf1b9d221d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.140914 Jan 26 19:29:43.414662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 341/706] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:43 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:43.821288 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:43.821895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:43.828178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.828631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.829410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.829845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.924427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:43.925026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:43.931106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.931550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.932502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:43.932933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:43.956090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:43.964633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:43.966125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:43.967275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-79999011-3dc3-40c5-9c84-79913f7ba959 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.149618 Jan 26 19:29:43.968076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 366/707] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:43 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:44.056275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:44.063934 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f9b68e25-bfb2-4b85-aae5-441fdaab2f72 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.143045 Jan 26 19:29:44.064496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 342/708] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:43 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:44.311023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-0c881be5-7c94-467b-bd1e-1bfecbfc18ea req-effc50df-7b9b-4c72-a219-0321f007a23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "name": "network-vif-plugged", "status": "completed", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:44.312986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:29:44.312986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:29:44.320376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-0c881be5-7c94-467b-bd1e-1bfecbfc18ea req-effc50df-7b9b-4c72-a219-0321f007a23a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:44.321021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-0c881be5-7c94-467b-bd1e-1bfecbfc18ea req-effc50df-7b9b-4c72-a219-0321f007a23a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:44.332342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-0c881be5-7c94-467b-bd1e-1bfecbfc18ea req-effc50df-7b9b-4c72-a219-0321f007a23a service nova] Creating event network-vif-plugged:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:29:44.337124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-0c881be5-7c94-467b-bd1e-1bfecbfc18ea req-effc50df-7b9b-4c72-a219-0321f007a23a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029717 Jan 26 19:29:44.338384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 367/709] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:29:44.430160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:44.430793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:44.436954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:44.437404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:44.438191 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:44.438619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:44.569754 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:44.579203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0df3003d-15c9-46be-a552-b661156a7fb4 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.152737 Jan 26 19:29:44.579765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 343/710] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:44 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:44.985894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:44.986585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:44.992560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:44.993010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:44.994271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:44.994704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:45.080181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:45.080859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:45.086895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:45.087341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:45.088136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:45.088564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:45.129276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:45.137138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:45.138626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:45.139753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c407d17d-bbfe-4d5a-8328-dd5b9cde0378 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.158316 Jan 26 19:29:45.140351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 368/711] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:44 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:45.219252 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:45.226913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b266d514-5156-4bd4-8882-135d9c47a7fb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.150582 Jan 26 19:29:45.227466 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 344/712] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:45 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:45.596268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:45.596864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:45.602648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:45.603665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:45.604447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:45.604876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:45.726964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:45.734669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1856c622-e36f-4335-8662-afe20cc4799f tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.141999 Jan 26 19:29:45.735232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 369/713] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:45 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:46.157978 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:46.158557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:46.164787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.165235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.166004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.166439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.244592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:46.245318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:46.251520 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.252015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.252888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.253326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.291057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:46.298821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:46.300331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:46.301469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-15eba406-63b3-4a11-8a7d-1532f7fdfb54 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.147215 Jan 26 19:29:46.302026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 345/714] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:46 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:46.382069 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:46.390339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bb28c0e4-a1b6-4b32-a7d9-78ae23b396e5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.149847 Jan 26 19:29:46.390911 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 370/715] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:46 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:46.751146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:46.751744 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:46.757664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.758108 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.758878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:46.759306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:46.881893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:46.888932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-abdc3315-3395-44c5-b173-a67996e393c6 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.141536 Jan 26 19:29:46.889483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 346/716] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:46 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:47.320018 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:47.320556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:47.327346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.327818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:47.328593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.329029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:47.407351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:47.408013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:47.414952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.414952 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:47.416736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.417203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:47.463200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:47.466015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:47.467512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:47.468771 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6e89b253-7c20-4563-b0c4-e93ea4041ddf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.152738 Jan 26 19:29:47.469328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 371/717] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:47 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:47.548472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:47.556058 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a2e539c-4914-47b7-ae7f-caf0936a8583 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.152508 Jan 26 19:29:47.556624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 347/718] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:47 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:47.905343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:47.905949 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:47.911715 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.912196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:47.912961 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:47.913396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:48.033776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:48.041433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-51fbef73-83b3-4488-8cd6-e2a70c8df0fc tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.139637 Jan 26 19:29:48.041996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 372/719] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:47 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:48.486038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:48.486665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:48.492823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:48.493311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:48.494077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:48.494503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:48.573066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:48.573669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:48.579979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:48.580428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:48.581201 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:48.581638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:48.619158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:48.627002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:48.628612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:48.629835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fbdfb71f-7cd8-47e2-bffd-6d16385f1cdc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.147428 Jan 26 19:29:48.630477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 348/720] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:48 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:48.711461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:48.719578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2a92c46f-2864-4e7d-a5b7-bea4d5160ee4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.150249 Jan 26 19:29:48.720172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 373/721] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:48 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:49.057594 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:49.058189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:49.064151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.064727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.065507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.065942 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.191390 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:49.199173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8cd35301-6f73-42cc-9e2d-ae622a64bfc5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.145202 Jan 26 19:29:49.199740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 349/722] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:49 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:49.647933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:49.648782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:49.655058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.655504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.656304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.656739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.736849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:49.737453 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:49.744260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.744714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.745493 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:49.745921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:49.780339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:49.788184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:49.789705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:49.791391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4917f6d7-bd95-449d-90a5-db0a39aeb66a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.147288 Jan 26 19:29:49.791984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 374/723] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:49 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:49.869872 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:49.877475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-15c1a57b-58d5-4722-a7ed-9178f3483407 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.144211 Jan 26 19:29:49.878033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 350/724] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:49 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:50.216007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:50.216612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:50.222451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.222895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.223661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.224138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.350192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:50.357517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7f675239-4f38-4d49-b338-65b7e54ec9db tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.145564 Jan 26 19:29:50.358186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 375/725] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:50 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:50.810096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:50.810641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:50.816998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.817561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.818456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.818891 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.894200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:50.894795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:50.901529 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.902038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.903575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:50.903575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:50.951192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:50.962237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:50.962237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:50.962237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-626c34d1-01dd-4699-b9a1-38aad1b92a31 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.156482 Jan 26 19:29:50.962500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 351/726] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:50 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:51.037031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:51.046255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6f52d213-3436-4dfc-8021-b2e8857b4c20 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.155696 Jan 26 19:29:51.046839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 376/727] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:50 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:51.374476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:51.375079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:51.380969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:51.381412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:51.382182 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:51.382627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:51.511550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:51.518815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-297865b5-2cb9-4170-ad89-4a6f0fa5e2e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.147942 Jan 26 19:29:51.519377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 352/728] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:51 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:51.979702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:51.980295 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:51.986372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:51.986811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:51.987571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:51.988028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:52.062966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:52.063984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:52.069566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:52.070013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:52.070784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:52.071215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:52.112919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:52.121694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:52.123265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:52.124515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-65c2b9ef-6782-4b75-a580-2f9ee30b271f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.148572 Jan 26 19:29:52.125076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 377/729] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:51 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:52.199080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:52.206654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b5c50e05-d29d-41f6-994e-28c77c7d1d25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.147398 Jan 26 19:29:52.207210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 353/730] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:52 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:52.535783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:52.536393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:52.542770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:52.543214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:52.544000 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:52.544428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:52.671732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:52.678777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b76e5d01-e564-4abf-8c0e-6d9a09d99768 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.146654 Jan 26 19:29:52.679353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 378/731] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:52 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:53.142753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:53.143348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:53.150223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.151154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.152074 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.152513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.223407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:53.224199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:53.231381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.231486 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.232337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.232900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.283450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:53.291841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:53.293340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:53.294506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d70a300c-426c-4326-bac8-a6d33252cf08 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.155508 Jan 26 19:29:53.295226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 354/732] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:53 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:53.358330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:53.366174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bf0987b7-a5dd-4794-b0bc-d7b341d77c90 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.146365 Jan 26 19:29:53.366742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 379/733] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:53 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:53.694751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:53.695349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:53.701879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.702326 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.703123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:53.703926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:53.834207 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:53.841299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24742c64-d1f1-4dce-a96c-443aa8c31fc3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.150249 Jan 26 19:29:53.841856 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 355/734] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:53 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:54.312450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:54.313054 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:54.319250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.319700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.320504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.320937 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.382866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:54.383604 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:54.389850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.390288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.391053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.391477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.448806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:54.456506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:54.457984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:54.459113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-063b0794-33f8-4804-953d-989e02133196 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.150380 Jan 26 19:29:54.459920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 380/735] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:54 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:54.517815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:54.526266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-af201df0-3b0d-4503-ae60-900c041c2464 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.146495 Jan 26 19:29:54.526858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 356/736] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:54 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:54.857862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:54.858587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:54.864836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.865389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.866264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:54.866712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:54.995842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:55.002914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d576214d-06a6-434a-91cc-7cc020d4a4d9 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.148813 Jan 26 19:29:55.003473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 381/737] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:54 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:55.477389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:55.477989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:55.485059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:55.485501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:55.486270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:55.486697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:55.543184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:55.543815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:55.550348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:55.550790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:55.551557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:55.552015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:55.611382 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:55.619172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:55.621216 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:55.622361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4bf68259-f7bc-4b7e-a49a-38436f51e791 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.148709 Jan 26 19:29:55.622918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 357/738] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:55 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:55.688533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:55.696146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7d79ee76-356d-4066-9af2-6d14ed1f858f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.157137 Jan 26 19:29:55.696718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 382/739] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:55 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:56.020837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:56.021466 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:56.028778 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.029222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.029991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.030421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.301424 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:56.308492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-671f8afc-7372-4837-b53a-009d17f66e8a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.291788 Jan 26 19:29:56.309053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 358/740] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:56 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:56.641038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:56.641663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:56.648138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.648837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.649607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.650039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.712622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:56.713255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:56.719401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.719883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.720668 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:56.721103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:56.776844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:56.784551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:56.786034 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:56.787172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c2f628fd-6c73-48bf-bd85-2065681a4783 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.149845 Jan 26 19:29:56.787729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 383/741] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:56 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:56.848619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:56.856259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c3753aa3-e1da-4583-b15b-35410b82aab3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1723 microversion: 2.1 time: 0.147207 Jan 26 19:29:56.856818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 359/742] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:56 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:57.329474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:57.329474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:57.333374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.333833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.334723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.335239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.543296 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:57.552360 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8db5d1e8-b5b9-47aa-9696-79d0c9abe16a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1359 microversion: 2.1 time: 0.230791 Jan 26 19:29:57.552932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 384/743] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:57 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:57.804895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:57.805507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:57.811850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.812299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.813079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.813513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.872865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:57.873887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:57.880460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.881075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.881963 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:57.882514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:57.949189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:57.958124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:57.959620 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:57.960790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-22d85880-4860-4445-a048-c160762e9fc4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.159577 Jan 26 19:29:57.961333 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 360/744] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:57 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:58.019984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:58.028740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0096b80b-f6cc-4fb7-9b17-2cedb269424e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1700 microversion: 2.1 time: 0.159723 Jan 26 19:29:58.029308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 385/745] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:57 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:58.045834 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-670f170d-62cd-41b5-bd5b-682d13079a6c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:29:58.051805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-670f170d-62cd-41b5-bd5b-682d13079a6c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.052267 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-670f170d-62cd-41b5-bd5b-682d13079a6c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.118908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-670f170d-62cd-41b5-bd5b-682d13079a6c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Going to try to start instance {{(pid=116105) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 26 19:29:58.158970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-670f170d-62cd-41b5-bd5b-682d13079a6c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 202 len: 0 microversion: 2.1 time: 0.117467 Jan 26 19:29:58.159622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 361/746] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:29:58 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:29:58.167485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:58.168196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:58.174036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.174518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.175242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.175672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.303807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:58.312240 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-46eba71b-2c3b-4b3d-83fe-ec31c8157f0a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1709 microversion: 2.1 time: 0.148326 Jan 26 19:29:58.312817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 386/747] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:58 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:58.497831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:58.498562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:58.508495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.508950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.509810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.510492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.569386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:58.570282 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:58.577393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.578139 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.579024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.579552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.599794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lazy-loading 'services' on Instance uuid 94bff8c8-e41b-421a-bf67-a4538f83efbc {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:29:58.721445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:58.726807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6e9d6ef0-05c3-48b7-aceb-a963ef1fcdb4 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "DELETE /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc/os-volume_attachments/73d777d6-4d73-44cf-8d32-f23c85bc8a68" status: 202 len: 0 microversion: 2.1 time: 0.233505 Jan 26 19:29:58.727510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 362/748] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:29:58 2022] DELETE /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc/os-volume_attachments/73d777d6-4d73-44cf-8d32-f23c85bc8a68 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:29:58.729731 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bda75628-59f1-44b6-a5b4-9dac21b10d90 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1549 microversion: 2.1 time: 0.164457 Jan 26 19:29:58.730570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 387/749] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:58 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:58.755450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:58.756168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:58.762358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.762811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.763587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.764057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.979676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:58.980334 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:58.983908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:58.988205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.988594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.989545 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:58.989978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:58.993815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-17de17b6-3d5f-4dff-bd71-b56e94600c78 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1549 microversion: 2.1 time: 0.250013 Jan 26 19:29:58.994641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 363/750] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:58 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:59.010479 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:59.014212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:29:59.014212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:29:59.016672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.017893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Searching by: {'deleted': False, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d'} {{(pid=116105) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 26 19:29:59.030613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.031745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.032236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.032788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.129316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.multi_cell_list [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116105) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 26 19:29:59.138348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.146056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.147552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.148966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2bb2466e-44d7-4f97-a064-dda993fdfec0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.173638 Jan 26 19:29:59.149521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 388/751] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:29:58 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:29:59.227789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0ee241a7-c5c0-404b-823f-e14218bb8947 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220695 Jan 26 19:29:59.229081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 364/752] 10.222.0.50 () {58 vars in 1124 bytes} [Wed Jan 26 19:29:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:29:59.239195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:59.239836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:59.245549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.246006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.246777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.247216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.329235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:29:59.329959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:29:59.335976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.336356 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.337132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:29:59.337565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:29:59.384140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.392063 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-55d33b67-bcbd-44cd-8986-a3a13095cc3a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1549 microversion: 2.1 time: 0.156590 Jan 26 19:29:59.392914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 389/753] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:59 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:29:59.471445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:29:59.479254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d13eb266-8435-467d-bb65-745b37be1e70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1709 microversion: 2.1 time: 0.153667 Jan 26 19:29:59.479950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 365/754] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:29:59 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:29:59.816231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:29:59.817125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:30:00.167624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:00.168258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:00.174403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:00.174823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:00.175593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:00.176039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:00.302446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:00.311008 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:00.312544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:00.314373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a19cd885-4201-4ad5-ac06-b447ed9be6b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.150911 Jan 26 19:30:00.314946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 390/755] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:00 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:00.496388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:00.496945 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:00.503070 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:00.503515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:00.504302 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:00.504731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:00.627664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:00.635407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-190d5a40-74cf-42b2-9139-81ba488ddf5d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1713 microversion: 2.1 time: 0.142744 Jan 26 19:30:00.635986 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 366/756] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:00 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1713 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:01.333038 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:01.333638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:01.340041 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.340488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.341265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.341694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.472565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:01.480683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:01.482152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:01.483280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e4f17a28-6dd8-4ad1-9d9b-69a87b104fa5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.154572 Jan 26 19:30:01.483865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 391/757] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:01 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:01.777725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-51b4f1dd-e7f2-44e3-aac1-c29ef388d6c1 req-a3e21cd1-b0e4-4c02-b5c8-4da8031e6a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "name": "network-vif-plugged", "status": "completed", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:01.777725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:01.777725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:01.779427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-51b4f1dd-e7f2-44e3-aac1-c29ef388d6c1 req-a3e21cd1-b0e4-4c02-b5c8-4da8031e6a1c service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.780048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-51b4f1dd-e7f2-44e3-aac1-c29ef388d6c1 req-a3e21cd1-b0e4-4c02-b5c8-4da8031e6a1c service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.792850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-51b4f1dd-e7f2-44e3-aac1-c29ef388d6c1 req-a3e21cd1-b0e4-4c02-b5c8-4da8031e6a1c service nova] Creating event network-vif-plugged:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:30:01.797951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-51b4f1dd-e7f2-44e3-aac1-c29ef388d6c1 req-a3e21cd1-b0e4-4c02-b5c8-4da8031e6a1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Jan 26 19:30:01.798634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 367/758] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:01.940606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eebf9b41-c552-4c0a-8933-ed2e4f0c7422"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:01.941720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:01.947572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.948047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.948817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.949244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.959596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:01.960291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:01.967034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.967546 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.968421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:01.968951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:01.993973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:30:02.066510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-94c5022d-bfe0-4ea5-9ec9-79902a24ab10 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "DELETE /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 204 len: 0 microversion: 2.1 time: 0.110494 Jan 26 19:30:02.067513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 368/759] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:30:01 2022] DELETE /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:30:02.075970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:02.076649 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:02.082477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:02.083820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:02.084825 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:02.085269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:02.206528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c47f7907-dace-4b58-a602-bf39ec704824 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269387 Jan 26 19:30:02.207232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 392/760] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:30:01 2022] POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:02.235193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:02.243420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9d799d45-d470-4081-b448-4887cfcf8de5 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1513 microversion: 2.1 time: 0.171091 Jan 26 19:30:02.244122 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 369/761] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:02 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:02.312646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1960632299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1418193573", "security_groups": [{"name": "tempest-secgroup-smoke-2049324900"}], "networks": [{"uuid": "cbb19803-443d-4415-86c7-ff03c2048d20"}], "block_device_mapping_v2": [{"uuid": "3978bbbe-08fc-47b8-8109-efa128dd30f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:02.424971 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] validate_networks() for [('cbb19803-443d-4415-86c7-ff03c2048d20', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:30:02.501353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:02.501918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:02.508045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:02.508486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:02.509307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:02.510239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:02.647326 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:02.657357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:02.658878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:02.660094 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-749e93e7-b298-4c6d-90d1-2962e46db74d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.162609 Jan 26 19:30:02.660669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 370/762] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:02 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:03.003283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:30:03.003695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:30:03.004194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:30:03.004620 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:30:03.005237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:30:03.013808 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.014250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.015058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.015492 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.033213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for project 84d90c74a445407ab6459be30826b3f7. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:30:03.036990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Getting quotas for user ac82831a8435454aae7a7669764bb8a9 and project 84d90c74a445407ab6459be30826b3f7. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:30:03.090513 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:30:03.092819 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3978bbbe-08fc-47b8-8109-efa128dd30f4',volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:30:03.213543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9e3981a2-b6a4-49c0-b62f-1881461bd487 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.907660 Jan 26 19:30:03.214173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 393/763] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:30:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 26 19:30:03.223749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7ee6475c-4821-4d79-81cc-d356d0943a85 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:03.224377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7ee6475c-4821-4d79-81cc-d356d0943a85 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:03.259810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:03.260576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:03.268031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.268496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.269268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.269881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.279948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7ee6475c-4821-4d79-81cc-d356d0943a85 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:03.288592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7ee6475c-4821-4d79-81cc-d356d0943a85 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1089 microversion: 2.1 time: 0.068424 Jan 26 19:30:03.298959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 371/764] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:03 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:03.408362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:03.416627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8d1d2861-396f-4731-b6b1-c7ed65f75646 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1513 microversion: 2.1 time: 0.159724 Jan 26 19:30:03.417375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 394/765] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:03 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:03.678837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:03.679449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:03.685340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.685792 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.686568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:03.687006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:03.874874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:03.884112 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:03.886122 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:03.887643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a308f9f4-fd62-4691-ac47-963f0ff65fa0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.212832 Jan 26 19:30:03.888254 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 372/766] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:03 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:04.306990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:04.307908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:04.331553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.332026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:04.332811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.333237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:04.408591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:04.417547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b6ab28f9-7e40-4107-af89-d68604234bc3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1187 microversion: 2.1 time: 0.114976 Jan 26 19:30:04.419390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 395/767] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:04 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:04.434283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:04.436019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:04.442478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.442916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:04.443699 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.444161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:04.791105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:04.799495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f44d9dd1-6c8c-47bb-8891-6a1c4a9afad9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 200 len: 1513 microversion: 2.1 time: 0.369294 Jan 26 19:30:04.800404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 373/768] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:04 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:04.907187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:04.908116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:04.914456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.915672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:04.915672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:04.916708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.062365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-e4e50405-115b-4b17-b8e8-c902d0c0796b req-6cc06309-91a5-42aa-ab62-8c4c9f094989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bff8c8-e41b-421a-bf67-a4538f83efbc", "name": "network-vif-deleted", "tag": "710bf98d-993e-427e-8c77-bdda25d5f13d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:05.066205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:05.066205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:05.097259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-e4e50405-115b-4b17-b8e8-c902d0c0796b req-6cc06309-91a5-42aa-ab62-8c4c9f094989 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:05.097886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-e4e50405-115b-4b17-b8e8-c902d0c0796b req-6cc06309-91a5-42aa-ab62-8c4c9f094989 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.132173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-e4e50405-115b-4b17-b8e8-c902d0c0796b req-6cc06309-91a5-42aa-ab62-8c4c9f094989 service nova] Creating event network-vif-deleted:710bf98d-993e-427e-8c77-bdda25d5f13d for instance 94bff8c8-e41b-421a-bf67-a4538f83efbc on hv-cinder-79400 Jan 26 19:30:05.138062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:05.142874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-e4e50405-115b-4b17-b8e8-c902d0c0796b req-6cc06309-91a5-42aa-ab62-8c4c9f094989 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085287 Jan 26 19:30:05.144528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 374/769] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:30:05.146645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:05.152753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:05.154206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b74f9446-39f4-46f4-b3a6-663d95dc41c2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1743 microversion: 2.20 time: 0.251923 Jan 26 19:30:05.156416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 396/770] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:04 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:05.438592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:05.439297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:05.451502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:05.452069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.453266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:05.454399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.557230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:05.575470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f106e9ca-c1be-4fd0-8c92-5973f59b1f47 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1205 microversion: 2.1 time: 0.141466 Jan 26 19:30:05.576473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 375/771] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:05 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1205 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:05.817602 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:05.818860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: 94bff8c8-e41b-421a-bf67-a4538f83efbc] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:05.834291 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:05.834985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.835995 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:05.836584 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:05.851322 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] HTTP exception thrown: Instance 94bff8c8-e41b-421a-bf67-a4538f83efbc could not be found. Jan 26 19:30:05.852287 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Returning 404 to user: Instance 94bff8c8-e41b-421a-bf67-a4538f83efbc could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:30:05.853382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-943287e1-2698-4931-9109-32f08d78593b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc" status: 404 len: 111 microversion: 2.1 time: 0.040279 Jan 26 19:30:05.854554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 397/772] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:05 2022] GET /compute/v2.1/servers/94bff8c8-e41b-421a-bf67-a4538f83efbc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:30:06.182580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:06.183344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:06.194051 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:06.194505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:06.195383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:06.195721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:06.511390 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:06.520145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:06.523925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:06.533639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-645c45c1-863e-4ca7-8c50-114bcc880ffb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.355535 Jan 26 19:30:06.536658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 376/773] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:06 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:06.594080 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:06.595348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:06.606548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:06.607276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:06.608264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:06.608852 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:06.891533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:06.899655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-80dd2526-c14e-462a-a82c-8c3cd2dda203 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.309963 Jan 26 19:30:06.905300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 398/774] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:06 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:07.171447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-3b63b169-65ce-4804-ad30-3c90d3b351a0 req-b49a4556-cd4a-40a5-b67c-17eddf0680e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:07.174571 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:07.174571 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:07.185032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-3b63b169-65ce-4804-ad30-3c90d3b351a0 req-b49a4556-cd4a-40a5-b67c-17eddf0680e6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:07.185800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-3b63b169-65ce-4804-ad30-3c90d3b351a0 req-b49a4556-cd4a-40a5-b67c-17eddf0680e6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:07.198636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-3b63b169-65ce-4804-ad30-3c90d3b351a0 req-b49a4556-cd4a-40a5-b67c-17eddf0680e6 service nova] Creating event network-changed:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:30:07.203634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-3b63b169-65ce-4804-ad30-3c90d3b351a0 req-b49a4556-cd4a-40a5-b67c-17eddf0680e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035728 Jan 26 19:30:07.204585 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 377/775] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:07.554362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:07.554987 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:07.561702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:07.562403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:07.563177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:07.563798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:07.746598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:07.759925 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:07.761723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:07.763078 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a5756764-d495-410d-9524-9b3db5e01287 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.212714 Jan 26 19:30:07.764187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 399/776] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:07 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:07.918405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:07.919101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:07.926811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:07.927473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:07.928560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:07.929003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:08.089619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:08.124185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9401cb09-4180-47ba-9779-d34ec7cc8d48 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.201704 Jan 26 19:30:08.125748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 378/777] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:07 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:08.782516 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:08.783154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:08.789713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:08.790164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:08.791573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:08.792039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:09.121400 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:09.129737 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:09.131419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:09.132751 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-20b0dc90-9e77-4518-8d48-a2536a064550 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.354599 Jan 26 19:30:09.142086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:09.143743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 400/778] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:08 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:09.144256 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:09.154607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:09.155738 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:09.156672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:09.157284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:09.309807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:09.317227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9cde590f-b923-41b5-af1b-d7a9f099b9cd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.178933 Jan 26 19:30:09.317799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 379/779] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:09 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:10.150478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:10.151056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:10.160146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:10.160878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:10.161668 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:10.162104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:10.336283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:10.337764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:10.342673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:10.354093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:10.359950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:10.361178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:10.361847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:10.375974 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:10.378694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:10.381272 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d4288651-8f87-469f-97a4-9f25251dd997 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.234660 Jan 26 19:30:10.382070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 401/780] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:10 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:10.654974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:10.667340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7a6dd450-7875-417a-a230-4bb8214b7b41 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.334670 Jan 26 19:30:10.678660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 380/781] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:10 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:11.401530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:11.403029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:11.409860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:11.410308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:11.411448 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:11.411919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:11.603218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:11.615515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:11.617074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:11.618227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-58c42000-a674-49b6-8766-f07aa2f6872b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.221613 Jan 26 19:30:11.619314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 402/782] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:11 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:11.686532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:11.687129 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:11.693806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:11.694260 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:11.695039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:11.695469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:11.849492 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:11.857767 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-385fbf3f-3360-46e6-9d9f-a287bd5ca6c5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.174905 Jan 26 19:30:11.858420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 381/783] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:11 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:12.636789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:12.637389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:12.644035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:12.644775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:12.645780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:12.646405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:12.789978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:12.798738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:12.800278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:12.801629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5fe48da9-822e-4c20-8b4e-90825caa5595 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.168575 Jan 26 19:30:12.802190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 403/784] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:12 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:12.877950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:12.879175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:12.886016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:12.886465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:12.887249 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:12.887706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:13.064013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:13.072521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6e835b9-0e31-432e-8ed2-b30340d7adf1 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.198431 Jan 26 19:30:13.073419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 382/785] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:12 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:13.820521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:13.821114 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:13.839694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:13.840195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:13.840995 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:13.841698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:13.993164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:14.003500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:14.005497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:14.007685 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eccee08d-de34-445d-9198-551005e73a3d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.190915 Jan 26 19:30:14.041639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 404/786] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:13 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:14.093218 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:14.094512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:14.111813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:14.114221 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:14.122400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:14.123038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:14.284976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:14.295442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-36feba41-ae46-4b28-8863-44dbf6c197c9 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.209536 Jan 26 19:30:14.296112 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 383/787] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:14 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:15.048585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:15.049169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:15.055367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:15.056468 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:15.057233 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:15.057660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:15.188510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:15.196439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:15.197983 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:15.199135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-03df4d1d-77b1-4922-b4b8-db0ea4ffc18c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.154315 Jan 26 19:30:15.199705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 405/788] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:15 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:15.313375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:15.313894 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:15.321558 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:15.322067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:15.322875 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:15.323555 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:15.742665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:15.749988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8b762c30-1a38-4b74-b689-7479a3d1ddd3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.440540 Jan 26 19:30:15.750490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 384/789] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:15 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:16.217148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:16.217674 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:16.226248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.226847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.228485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.228485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.373871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:16.381707 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:16.383210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:16.384985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8964027a-c9f4-4235-bf99-285b1a4855e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1738 microversion: 2.20 time: 0.172026 Jan 26 19:30:16.385538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 406/790] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:16 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:16.386302 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:16.386906 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:16.393246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.393685 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.394498 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.394931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.524266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:16.532100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-721a3fb2-39dc-443a-9479-39822170dc9e tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1595 microversion: 2.1 time: 0.150125 Jan 26 19:30:16.532665 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 385/791] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:16 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1595 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:16.767235 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:16.768010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:16.774380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.775107 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.776467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:16.777110 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:16.950070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:16.963265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-917aa578-02b1-4f8c-8064-15d4ac55179f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1273 microversion: 2.1 time: 0.199798 Jan 26 19:30:16.967684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 407/792] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:16 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:17.403339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:17.403980 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:17.410451 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:17.410934 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:17.411725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:17.412188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:17.751706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:17.760049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:17.761625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:17.762776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-431c9659-ccd8-4309-8446-49376c4f422c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.363874 Jan 26 19:30:17.763385 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 386/793] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:17 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:17.981681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:17.982924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:17.990514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:17.990971 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:17.991797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:17.992250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:18.134298 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:18.142682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cfa5f8f7-b17e-485f-bf3d-c44ff1319bcc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.165918 Jan 26 19:30:18.143414 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 408/794] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:17 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:18.782142 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:18.782736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:18.790748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:18.791189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:18.791996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:18.792419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:19.011730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:19.021041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:19.022715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:19.024359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-457ffdba-b728-4ed4-8be3-02e0d2753100 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.246514 Jan 26 19:30:19.025532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 387/795] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:18 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:19.161375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:19.161988 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:19.168897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:19.170607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:19.170607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:19.170607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:19.220877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-b8d56b2a-2901-47dc-a5ce-c6f0fc5c8971 req-1f80a892-6c41-406d-9142-8828f302ed98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:19.222561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:19.222561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:19.229927 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-b8d56b2a-2901-47dc-a5ce-c6f0fc5c8971 req-1f80a892-6c41-406d-9142-8828f302ed98 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:19.230634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-b8d56b2a-2901-47dc-a5ce-c6f0fc5c8971 req-1f80a892-6c41-406d-9142-8828f302ed98 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:19.241652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-b8d56b2a-2901-47dc-a5ce-c6f0fc5c8971 req-1f80a892-6c41-406d-9142-8828f302ed98 service nova] Creating event network-changed:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:30:19.248699 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-b8d56b2a-2901-47dc-a5ce-c6f0fc5c8971 req-1f80a892-6c41-406d-9142-8828f302ed98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Jan 26 19:30:19.249858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 388/796] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:30:19.401418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:19.425749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d8dd8ed2-31e9-4af8-9036-2a55a6a2dd1d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.268149 Jan 26 19:30:19.426816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 409/797] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:19 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:20.046779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:20.048087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:20.057346 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.058002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.059957 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.060561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.308703 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:20.333000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:20.334488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:20.339166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f0465f31-315f-4131-a518-02eb98eb86a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.299742 Jan 26 19:30:20.343459 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 389/798] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:20 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:20.444223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:20.444824 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:20.451160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.451886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.452130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-253398764"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:20.452650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:20.452764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.453121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.458497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.459152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.459999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.460619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.629972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.network.security_group_api [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Adding security group c9bd21fc-ac84-46a8-b63d-25faf928ca85 to port a92f78fe-a95a-433e-ae74-1d826804d788 Jan 26 19:30:20.632769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:20.640837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-29dd0e94-40fd-4674-a001-39605262555d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.200712 Jan 26 19:30:20.641708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 410/799] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:20 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:20.965399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c3e5d16f-826a-4890-92e3-045d3211d85a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action" status: 202 len: 0 microversion: 2.1 time: 0.516910 Jan 26 19:30:20.966144 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 390/800] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:30:20 2022] POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:30:20.974020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:20.974632 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:20.981252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.981704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:20.982528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:20.983012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.133616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:21.142772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7823f3a6-ce32-4495-aefc-23e4593db648 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1641 microversion: 2.1 time: 0.172332 Jan 26 19:30:21.143524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 411/801] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:20 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1641 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:21.264659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-ae546e29-be55-4ba1-9189-f58c14a499c7 req-7366976c-e2f0-43d7-9ecf-c7568bae7b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:21.266339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:21.266339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:21.273480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ae546e29-be55-4ba1-9189-f58c14a499c7 req-7366976c-e2f0-43d7-9ecf-c7568bae7b7c service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:21.274020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ae546e29-be55-4ba1-9189-f58c14a499c7 req-7366976c-e2f0-43d7-9ecf-c7568bae7b7c service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.285444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-ae546e29-be55-4ba1-9189-f58c14a499c7 req-7366976c-e2f0-43d7-9ecf-c7568bae7b7c service nova] Creating event network-changed:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:30:21.290383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-ae546e29-be55-4ba1-9189-f58c14a499c7 req-7366976c-e2f0-43d7-9ecf-c7568bae7b7c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029691 Jan 26 19:30:21.290962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 391/802] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:21.360649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:21.361248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:21.367068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:21.367515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.368802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:21.369243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.501678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:21.510413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:21.511926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:21.513079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3c0f5095-3629-4fc6-8646-2454b9339d25 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.156167 Jan 26 19:30:21.513629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 412/803] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:21 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:21.658698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:21.659414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:21.665658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:21.666096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.666857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:21.667312 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:21.801115 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:21.808903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-178b49bb-ff67-48eb-a21e-0c891b041c2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.154243 Jan 26 19:30:21.809458 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 392/804] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:21 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:22.530716 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:22.531342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:22.537415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:22.537854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:22.538614 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:22.539042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:22.668660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:22.676503 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:22.678005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:22.679144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4101bdb1-f060-4b0d-b70b-9236766c624e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.152093 Jan 26 19:30:22.679697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 413/805] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:22 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:22.825690 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:22.826321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:22.833276 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:22.833724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:22.834508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:22.834933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:23.052072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:23.059970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b04ccb9e-4927-42ab-aff1-4ce5fef2dae2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.238251 Jan 26 19:30:23.060624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 393/806] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:22 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:23.286794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1961493337", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "cb61a227-3f6a-4a64-829c-bff22f962c01"}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:23.334934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] validate_networks() for [('cb61a227-3f6a-4a64-829c-bff22f962c01', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:30:23.696786 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:23.697379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:23.703049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:23.703496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:23.704300 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:23.704732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:23.713344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:30:23.713832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:30:23.714222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:30:23.714603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:30:23.715005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:30:23.724814 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:23.725228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:23.726033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:23.726474 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:23.745425 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Getting quotas for project cf8d9c9de7c8480db8e23bb4bac96785. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:30:23.749556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Getting quotas for user 18d1dd6d9d0940d594152a246259a18b and project cf8d9c9de7c8480db8e23bb4bac96785. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:30:23.761427 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:30:23.763692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:30:23.815191 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a056bdda-4edd-4ed3-9557-301dc49a9079 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531801 Jan 26 19:30:23.819962 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 414/807] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:30:23.826297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-890a57b7-094a-4ff5-9ce8-732bede8d6bd tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:23.827311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-890a57b7-094a-4ff5-9ce8-732bede8d6bd tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:23.885866 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-890a57b7-094a-4ff5-9ce8-732bede8d6bd tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:23.904834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-890a57b7-094a-4ff5-9ce8-732bede8d6bd tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1219 microversion: 2.1 time: 0.082628 Jan 26 19:30:23.905405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 415/808] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:23 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:24.006657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:24.017647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:24.019407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:24.020584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cba0d1c2-78fb-48e1-83e3-1e3dff9ead78 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1720 microversion: 2.20 time: 0.327565 Jan 26 19:30:24.021316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 394/809] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:23 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1720 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:24.076787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:24.077442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:24.083203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:24.083654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:24.084458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:24.084919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:24.224597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:24.234627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3367c97d-55c3-42c0-a304-058379bfbda7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.161364 Jan 26 19:30:24.235813 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 416/810] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:24 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:24.933982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:24.934868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:24.942775 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:24.943910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:24.945339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:24.945959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:24.949611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-c1050fdb-1bda-4a93-8850-a899ddfb089e req-bf64622f-08a2-43ee-bf7e-4be80f7e7ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "name": "network-vif-unplugged", "status": "completed", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:24.952700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:24.952700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:30:24.961227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c1050fdb-1bda-4a93-8850-a899ddfb089e req-bf64622f-08a2-43ee-bf7e-4be80f7e7ed0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:24.961996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c1050fdb-1bda-4a93-8850-a899ddfb089e req-bf64622f-08a2-43ee-bf7e-4be80f7e7ed0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:24.987817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.compute.server_external_events [req-c1050fdb-1bda-4a93-8850-a899ddfb089e req-bf64622f-08a2-43ee-bf7e-4be80f7e7ed0 service nova] Unable to find a host for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5. Dropping event network-vif-unplugged {{(pid=116106) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 26 19:30:24.995248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-c1050fdb-1bda-4a93-8850-a899ddfb089e req-bf64622f-08a2-43ee-bf7e-4be80f7e7ed0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047591 Jan 26 19:30:24.996520 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 417/811] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 26 19:30:25.039364 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:25.040551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:25.046587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.047035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.047827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.048263 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.153812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:25.161183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6cb1bdc-c82d-42d8-aea3-e9a7b843ef9c tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1277 microversion: 2.1 time: 0.235447 Jan 26 19:30:25.161741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 395/812] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:24 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:25.250299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:25.250905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:25.257388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.258100 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.258949 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.259551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.265659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:25.286370 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:25.287894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:25.289441 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-de3934fa-8967-4adc-b947-5ac102e19647 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1663 microversion: 2.20 time: 0.253319 Jan 26 19:30:25.304264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 418/813] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:25 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1663 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:25.324309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3b60acb-2082-4c2c-8b74-54e64551359f"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:25.325349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:25.331167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.331620 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.332470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.332900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.511224 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:25.523974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-565f750c-8fb5-4cf2-b1fe-8ed58e38cd26 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.276999 Jan 26 19:30:25.525407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 396/814] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:25 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:25.673072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-89a439b4-8475-4aca-9124-8729a3cb9fea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354537 Jan 26 19:30:25.673667 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 419/815] 10.222.0.50 () {62 vars in 1363 bytes} [Wed Jan 26 19:30:25 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments => generated 188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:30:25.795396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:25.796693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:25.803811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.804488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:25.805273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:25.805881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.028942 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0820a3b6-4e0b-46be-9869-08bf54d4420c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action" status: 202 len: 0 microversion: 2.20 time: 0.238053 Jan 26 19:30:26.029551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 397/816] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:30:25 2022] POST /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:30:26.038048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:26.038617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:26.045910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.046405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.047187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.047616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.178893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:26.179425 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:26.188193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.188645 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.189442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.189877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.225321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:26.234939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:26.236470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:26.238030 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bac7f894-a6c4-4382-a25c-149b707b9828 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1749 microversion: 2.20 time: 0.204294 Jan 26 19:30:26.239085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 420/817] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:26 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1749 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:26.501200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:26.508901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9067a247-8bda-4e6a-b0ea-dd9cda0dcb4f tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.333974 Jan 26 19:30:26.509477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 398/818] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:26 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:26.542266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:26.543039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:26.549746 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.550187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.551142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:26.551577 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:26.710463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:26.719657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f1c136c9-4d62-4a92-8240-fc30058d2237 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.181740 Jan 26 19:30:26.720490 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 421/819] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:26 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:27.117679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-8fcb38da-850e-4261-8456-123fd4fa69e4 req-1c3fe042-5629-4a60-a7b8-2149eff97853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add797ce-1fd7-4b5d-81f4-c663300f73db", "tag": "23655e28-0e22-4e0b-8e45-e1b3b22a2df3"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:27.120233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:27.120233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:27.130590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8fcb38da-850e-4261-8456-123fd4fa69e4 req-1c3fe042-5629-4a60-a7b8-2149eff97853 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.131717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8fcb38da-850e-4261-8456-123fd4fa69e4 req-1c3fe042-5629-4a60-a7b8-2149eff97853 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.146617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-8fcb38da-850e-4261-8456-123fd4fa69e4 req-1c3fe042-5629-4a60-a7b8-2149eff97853 service nova] Creating event network-changed:23655e28-0e22-4e0b-8e45-e1b3b22a2df3 for instance add797ce-1fd7-4b5d-81f4-c663300f73db on hv-cinder-79400 Jan 26 19:30:27.153790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-8fcb38da-850e-4261-8456-123fd4fa69e4 req-1c3fe042-5629-4a60-a7b8-2149eff97853 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130093 Jan 26 19:30:27.155510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 399/820] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:30:27.257907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:27.260230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:27.269531 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.269986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.270825 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.271552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.527247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:27.527721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:27.538740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.539283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.540125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.540730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.566972 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:27.580147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:27.581950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:27.583875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-747ffb17-08a0-43cf-b318-5966d4e0036a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1751 microversion: 2.20 time: 0.330302 Jan 26 19:30:27.584952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 422/821] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:27 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1751 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:27.737508 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:27.738146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:27.751312 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.752103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.752901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:27.753331 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:27.879964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:27.895275 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-55de176b-1020-4fc0-8a00-ff4d8eb33d2a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.372907 Jan 26 19:30:27.896797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 400/822] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:27 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:28.036344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:28.044790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7c4d3cad-035b-4a1c-9456-471586697bb5 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.311007 Jan 26 19:30:28.045373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 423/823] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:27 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:28.605048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:28.606311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:28.614476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:28.615414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:28.616406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:28.617004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:28.794732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:28.806192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:28.808413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:28.810039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ecc4d52d-daef-4ec8-82a9-9263e014ef70 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.211290 Jan 26 19:30:28.811678 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 401/824] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:28 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:28.913774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:28.915710 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:28.923604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:28.924519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:28.925308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:28.925900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:29.061270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:29.062830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:29.074889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:29.075365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:29.076746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:29.077362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:29.199363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:29.208455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f904338f-098f-40cc-8100-5049e7484868 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.300150 Jan 26 19:30:29.209413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 424/825] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:28 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:29.232807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:29.240981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-835f9c13-4a54-49e4-a6b2-a9a52e43926a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.183111 Jan 26 19:30:29.243822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 402/826] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:29 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:29.831451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:29.832493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:29.844135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:29.845041 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:29.848552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:29.849369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:30.132622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:30.144717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:30.151410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:30.155071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-13708bba-a42f-4c71-86f0-388605510dc6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.328885 Jan 26 19:30:30.157669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 425/827] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:29 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:30.229025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:30.230068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:30.250301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:30.251147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:30.252718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:30.253259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:30.260488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:30.261098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:30.271640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:30.272359 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:30.273690 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:30.275253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:30.499090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:30.507361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e2ce6b22-9491-45f4-b3cd-6c83fd7ae360 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.285343 Jan 26 19:30:30.509172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 403/828] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:30 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:30.704897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:30.712415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e3f326a8-607f-4cb9-8920-39d338e8cf2c tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.458463 Jan 26 19:30:30.713001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 426/829] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:30 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:31.173634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:31.174231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:31.181379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.181820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.184315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.184752 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.386020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:31.395556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:31.397237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:31.408809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4e53d75f-4073-4974-b549-fabd1c97cb52 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.238622 Jan 26 19:30:31.411927 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 404/830] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:31 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:31.525533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:31.526773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:31.545344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.545800 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.546604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.547037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.729182 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:31.729695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:31.736251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.737053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.737848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:31.738277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:31.905626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:31.925523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f9d76e7e-0a97-4623-afc8-17e98b35016b tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.404776 Jan 26 19:30:31.930729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 427/831] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:31 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:31.935026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:31.944716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e034f412-8a71-48df-b94c-3d2c4a556887 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.219382 Jan 26 19:30:31.945307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 405/832] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:31 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:32.427821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:32.428422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:32.438183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.438923 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:32.439724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.440190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:32.625568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:32.635471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:32.640127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:32.642023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f03fe5d9-abbf-4f6a-ade9-b05a585e0092 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.218479 Jan 26 19:30:32.643218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 428/833] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:32 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:32.946550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:32.947551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:32.960514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.962811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:32.963651 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:32.967731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:32.968761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.970941 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:32.974373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.974838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:32.978304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:32.978743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:33.286257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:33.298223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0eb89958-50e6-4963-935d-e4aff3005e05 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.355918 Jan 26 19:30:33.299540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 406/834] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:32 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:33.320371 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:33.328942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bf3434cf-29da-4901-a4ba-1042e2881b8d tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.370277 Jan 26 19:30:33.331043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 429/835] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:32 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:33.663669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:33.664696 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:33.697754 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:33.698564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:33.700164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:33.713750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:34.069318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:34.078800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:34.086881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:34.088147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e86effc0-1736-4784-9213-4c032ab69fa9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.430220 Jan 26 19:30:34.088831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 407/836] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:33 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:34.326838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:34.328942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:34.338532 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:34.339335 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:34.340380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:34.340975 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:34.353170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:34.353394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:34.359751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:34.360231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:34.361038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:34.376210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:34.689857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:34.702266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b38f6710-7fe9-48d9-a4f8-c9edf75c1306 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.383316 Jan 26 19:30:34.703971 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 430/837] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:34 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:34.947657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:34.957989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fa291af6-4fc4-4b2b-a7c7-3c416cfb0ad0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.612969 Jan 26 19:30:34.959426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 408/838] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:34 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:35.108391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:35.119556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:35.127283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:35.128183 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:35.131740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:35.132524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:35.467747 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-40edbd80-71f9-4ccb-b079-e201a73d217f req-91babc73-179e-4507-adee-adfe81907316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add797ce-1fd7-4b5d-81f4-c663300f73db", "name": "network-vif-plugged", "status": "completed", "tag": "23655e28-0e22-4e0b-8e45-e1b3b22a2df3"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:35.468902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:35.472416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:35.472416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:35.509228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:35.516431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:35.521566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-40edbd80-71f9-4ccb-b079-e201a73d217f req-91babc73-179e-4507-adee-adfe81907316 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:35.522627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-40edbd80-71f9-4ccb-b079-e201a73d217f req-91babc73-179e-4507-adee-adfe81907316 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:35.522854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fa143140-141f-4799-b3ed-2c2b3d522eb8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.419070 Jan 26 19:30:35.526603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 431/839] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:35 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:35.551394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-40edbd80-71f9-4ccb-b079-e201a73d217f req-91babc73-179e-4507-adee-adfe81907316 service nova] Creating event network-vif-plugged:23655e28-0e22-4e0b-8e45-e1b3b22a2df3 for instance add797ce-1fd7-4b5d-81f4-c663300f73db on hv-cinder-79400 Jan 26 19:30:35.568298 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-40edbd80-71f9-4ccb-b079-e201a73d217f req-91babc73-179e-4507-adee-adfe81907316 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109267 Jan 26 19:30:35.569474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 409/840] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:30:35.721882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:35.727627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:35.735705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:35.737658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:35.741032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:35.741687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:35.987082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:35.987806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:36.016571 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:36.025940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:36.033136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:36.056241 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:36.181027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:36.208782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7824a3bd-47d4-4908-bd86-791f96f19010 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.491380 Jan 26 19:30:36.210296 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 432/841] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:35 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:36.557125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:36.561525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:36.582459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:36.583197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:36.584636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:36.585248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:36.668643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:36.687509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-33f3a46e-99c0-42c9-9898-c3393c1d3be7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.714755 Jan 26 19:30:36.692861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 410/842] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:35 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:36.886656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:36.895724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:36.897248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:36.902877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-08f2009b-2551-4fa9-a3f2-96b27b390520 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.356660 Jan 26 19:30:36.913121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 433/843] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:36 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:37.226353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:37.227981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:37.237105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.237558 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.251259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.251716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.664125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:37.679257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-309a77a8-837d-4147-ba80-0b16910c28da tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.456433 Jan 26 19:30:37.681522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 411/844] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:37 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:37.708912 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:37.709509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:37.733740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.734522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.735549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.738753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.761884 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-c949a1c4-e92a-491f-ad3a-08368d56a807 req-6e6a0cd2-ac06-4351-87fa-dc17dcce4489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "name": "network-vif-plugged", "status": "completed", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:37.764140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:37.764140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:30:37.783830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c949a1c4-e92a-491f-ad3a-08368d56a807 req-6e6a0cd2-ac06-4351-87fa-dc17dcce4489 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.784321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c949a1c4-e92a-491f-ad3a-08368d56a807 req-6e6a0cd2-ac06-4351-87fa-dc17dcce4489 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.834044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-c949a1c4-e92a-491f-ad3a-08368d56a807 req-6e6a0cd2-ac06-4351-87fa-dc17dcce4489 service nova] Creating event network-vif-plugged:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:30:37.857910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-c949a1c4-e92a-491f-ad3a-08368d56a807 req-6e6a0cd2-ac06-4351-87fa-dc17dcce4489 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097756 Jan 26 19:30:37.859787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 412/845] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:37.923850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:37.925372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:37.945156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.946879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:37.951443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:37.954615 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:38.008415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:38.037173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-af8cf340-c1fb-4256-8f35-597b15079e7f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.331781 Jan 26 19:30:38.038098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 434/846] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:37 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:38.585099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:38.597217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:38.600083 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:38.601655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-186807c0-40e0-4232-9291-0f0b2d695e58 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.682872 Jan 26 19:30:38.603391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 413/847] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:37 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:38.697916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:38.699015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:38.718415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:38.719094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:38.724362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:38.725138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:39.056902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:39.057484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:39.074345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:39.075144 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:39.075578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:39.081257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:39.113977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:39.130616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-63934211-11e7-488d-8bad-963c271d2f08 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.435874 Jan 26 19:30:39.134607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 435/848] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:38 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:39.481192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:39.527049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3312a3c2-cc45-4769-b861-252835541b34 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.476309 Jan 26 19:30:39.544212 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 414/849] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:39 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:39.622069 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:39.622994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:39.637155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:39.639959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:39.640972 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:39.644413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:40.000253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:40.026353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:40.028321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:40.029801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7385e09f-1666-43fc-8d50-868fa4418208 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.412859 Jan 26 19:30:40.030644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 436/850] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:39 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:30:40.164114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:40.164114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:40.164114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:40.164114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:40.175220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:40.182420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:40.550320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:40.550913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:40.557451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:40.560377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:40.564523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:40.567434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:40.661327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:40.670541 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a010576f-1711-416f-ba4b-5f8214da73cb tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.522988 Jan 26 19:30:40.671174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 415/851] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:40 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:40.997736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:41.010729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7d302d76-178b-49b8-bdf7-eb77a3dc3a3b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.464020 Jan 26 19:30:41.012604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 437/852] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:40 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:41.053278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:41.056494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:41.076536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:41.077501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:41.078734 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:41.086608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:41.686803 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:41.687515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:41.719165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:41.719967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:41.725765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:41.726323 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:41.901403 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:41.922071 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:41.927692 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:41.931102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65b95147-4157-49aa-9f00-6783e72f2749 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.886546 Jan 26 19:30:41.937227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 416/853] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:41 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:42.026128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:42.029076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:42.029679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:42.039654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:42.045079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:42.046031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b15bacea-c2fe-4e17-a05c-54615b66b1cf tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.356407 Jan 26 19:30:42.046703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 438/854] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:41 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:42.047828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:42.048452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:42.294322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:42.302202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0902f43a-e1bf-4939-ad17-748019743716 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.277259 Jan 26 19:30:42.303612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 417/855] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:42 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:42.606359 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Action: 'create', calling method: .version_select at 0x7fb7c0da6ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1429712429"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:42.622523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:30:42.626642 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for user 477b689bf5c0415aa7eba64b81d8602a and project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:30:42.907269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:30:42.911888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for user 477b689bf5c0415aa7eba64b81d8602a and project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'key_pairs'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:30:42.929149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1f3cd539-47e0-4aa9-9cec-c11dbb86af71 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.570352 Jan 26 19:30:42.936950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 439/856] 10.222.0.50 () {60 vars in 1157 bytes} [Wed Jan 26 19:30:42 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:42.953322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:42.954550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:42.965475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:42.965935 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:42.966777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:42.967427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:43.071277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:43.072229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:43.080235 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:43.080913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:43.081698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:43.082483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:43.171509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:43.181973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:43.183926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:43.187287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-524e86ec-cf63-4e85-8a44-4c66a3e69ef6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.238508 Jan 26 19:30:43.188572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 418/857] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:42 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:43.322753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:43.323733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:43.331955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:43.332953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:43.333954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:43.335398 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:43.371645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:43.389616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-85609d5b-448f-4006-860c-b790cb2b6367 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.325251 Jan 26 19:30:43.395955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 440/858] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:43 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:43.635599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:43.647056 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c8f1a54-ab02-4ac9-be87-6e18cf559386 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.330213 Jan 26 19:30:43.649206 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 419/859] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:43 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:44.206327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:44.207073 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:44.215248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.216423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.217449 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.218095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.401017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:44.407137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:44.408660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:44.414289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:44.416059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:44.419604 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.419809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-63c5267e-3500-492c-b3ad-64eb6b74b7a6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.215068 Jan 26 19:30:44.419809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 441/860] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:44 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:44.427405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.428681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.429321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.585274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:44.594992 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e22e42be-3da6-47a2-ab7f-e8dba065251d tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.192319 Jan 26 19:30:44.597149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 420/861] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:44 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:44.665365 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:44.666337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:44.672736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.673261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.674121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:44.674617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:44.850641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:44.860185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d9fc05f6-16b9-49f7-89f0-6ad1d1801afc tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.198987 Jan 26 19:30:44.860844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 442/862] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:44 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:45.436673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:45.437983 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:45.444621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.445070 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.446469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.446896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.614268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:45.616020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:45.628089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.628996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.630693 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.631104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.663642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:45.694982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:45.697509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:45.699163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-21eddf48-372a-4a7b-8ee2-04215be8040d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.266284 Jan 26 19:30:45.699986 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 421/863] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:45 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:45.878991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:45.880518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:45.894503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.897752 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.901621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:45.902341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:45.932880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:45.940843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-55b791fd-e49e-41c1-8704-6657fbae4bc0 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.332174 Jan 26 19:30:45.942124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 443/864] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:45 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:46.071417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:46.081178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6a20dad3-57b2-4eee-93c3-0277dc0700d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.206734 Jan 26 19:30:46.081750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 422/865] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:45 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:46.718443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:46.719635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:46.730418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:46.732579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:46.733398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:46.733832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:46.943458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:46.957434 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:46.958167 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:46.965525 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:46.966093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:46.966613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:46.966997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:46.967439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:46.970611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:46.972122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-418e28c8-3e29-41fd-883b-31db7e77db84 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.257991 Jan 26 19:30:46.988555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 444/866] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:46 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:47.099184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:47.100056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:47.106293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:47.106942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:47.107926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:47.108849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:47.194388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:47.203369 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7b58eef1-ac5c-486e-8f2b-2873252b00f6 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.249493 Jan 26 19:30:47.203984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 423/867] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:46 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:47.274756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:47.282567 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c5692c07-656d-4ea6-9380-7ac5c84e27d3 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1261 microversion: 2.1 time: 0.188178 Jan 26 19:30:47.283924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 445/868] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:47 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:30:47.990240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:47.990839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:47.997135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:47.997586 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:47.998362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:47.998799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.126892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.135604 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.137392 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.138552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e1d785aa-4e35-4957-9454-8360882132e5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.152028 Jan 26 19:30:48.139104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 424/869] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:47 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:48.220037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:48.220647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:48.227211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.227658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.228466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.228907 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.306211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:48.306782 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:48.313157 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.313610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.314416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.314854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.453679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.461402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c400f2e8-5e1b-4530-b446-d807d25feb5b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1445 microversion: 2.1 time: 0.164034 Jan 26 19:30:48.462687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 425/870] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:48 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:48.479248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:48.480121 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:48.486356 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.486798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.487576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:48.488041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:48.532407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.540142 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d30d34ab-2a08-4c8a-943a-c0ba7831e8d1 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1319 microversion: 2.1 time: 0.323958 Jan 26 19:30:48.540992 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 446/871] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:48 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:48.628009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:48.638121 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e4ca8575-c9e3-47cc-8de1-1049e59b826f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1445 microversion: 2.1 time: 0.160667 Jan 26 19:30:48.640947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 426/872] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:48 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:49.158116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:49.158827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:49.165748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.166278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.167129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.167658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.428883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:49.437253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:49.438753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:49.439932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-da2ca5c2-b731-4da5-bfe4-d54b603648bb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.285571 Jan 26 19:30:49.440466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 447/873] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:49 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:49.556868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:49.557473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:49.564442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.564885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.565672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.566291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.697509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:49.704769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bbb1a3a2-9a2a-44fe-b692-12962a9ebc63 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1507 microversion: 2.1 time: 0.151565 Jan 26 19:30:49.705342 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 427/874] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:30:49 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:30:49.725223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11b87639-438f-4cd4-872c-9aa41998fbb0", "device": "/dev/sdb"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:49.726925 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:49.733141 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.733737 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.734593 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:49.735128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:49.973881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b2fadc9c-3244-4b5a-847a-07f76214a457 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "POST /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252275 Jan 26 19:30:49.974860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 448/875] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:30:49 2022] POST /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:50.457517 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:50.458116 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:50.464105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:50.464569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:50.465415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:50.465851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:50.604125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:50.612426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:50.613923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:50.615075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72bfbddf-84f3-49a1-bee2-9aba1ea5f17d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.161535 Jan 26 19:30:50.615745 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 428/876] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:50 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:50.787045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-c77a01cb-3203-4858-b95a-88f8919c761e req-21b143cd-7e34-4fa7-88fb-0d8669f6e1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:50.788581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:50.788581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:30:50.796413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c77a01cb-3203-4858-b95a-88f8919c761e req-21b143cd-7e34-4fa7-88fb-0d8669f6e1ed service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:50.796851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c77a01cb-3203-4858-b95a-88f8919c761e req-21b143cd-7e34-4fa7-88fb-0d8669f6e1ed service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:50.807252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-c77a01cb-3203-4858-b95a-88f8919c761e req-21b143cd-7e34-4fa7-88fb-0d8669f6e1ed service nova] Creating event network-changed:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:30:50.812103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-c77a01cb-3203-4858-b95a-88f8919c761e req-21b143cd-7e34-4fa7-88fb-0d8669f6e1ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083009 Jan 26 19:30:50.814682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 449/877] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:51.634274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:51.634884 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:51.641120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:51.641568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:51.642344 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:51.642774 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:51.779610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:51.788048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:51.790000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:51.791353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-39a3d497-b10e-4a3f-962d-75cc50d8cab9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.161446 Jan 26 19:30:51.791946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 429/878] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:51 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:52.810131 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:52.810851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:52.816926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:52.817377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:52.818168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:52.818600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:52.949689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:52.958039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:52.959544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:52.960713 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ccae366c-d752-491e-8305-dde91b595999 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.155092 Jan 26 19:30:52.961287 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 450/879] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:52 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:53.978914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:53.979503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:53.985796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:53.986234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:53.986999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:53.987430 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:54.116402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:54.125459 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:54.126963 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:54.128154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-457ff474-fa33-4e43-adae-04585aa2f3c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.153427 Jan 26 19:30:54.128720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 430/880] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:53 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:55.145363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:55.146213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:55.153442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:55.153915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:55.154687 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:55.155119 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:55.286976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:55.295317 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:55.296929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:55.298070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b56116e8-1210-4737-af19-0fbb5ff4950b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.156607 Jan 26 19:30:55.298759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 451/881] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:55 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:56.316244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:56.316841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:56.323994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:56.324439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:56.325228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:56.325660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:56.453837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:56.463309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:56.464823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:56.465977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a11eb0a2-deaa-432e-817b-a22ab5230d97 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.153404 Jan 26 19:30:56.466532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 431/882] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:56 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:57.240214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-6a2bb429-1f30-4820-bd89-417471cb4cf1 req-b1d89d05-4c89-4c2d-9d35-f18241bbafa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "name": "network-vif-plugged", "status": "completed", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:30:57.242661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:30:57.242661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:30:57.253546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6a2bb429-1f30-4820-bd89-417471cb4cf1 req-b1d89d05-4c89-4c2d-9d35-f18241bbafa0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:57.254086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6a2bb429-1f30-4820-bd89-417471cb4cf1 req-b1d89d05-4c89-4c2d-9d35-f18241bbafa0 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:57.265313 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-6a2bb429-1f30-4820-bd89-417471cb4cf1 req-b1d89d05-4c89-4c2d-9d35-f18241bbafa0 service nova] Creating event network-vif-plugged:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:30:57.270556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-6a2bb429-1f30-4820-bd89-417471cb4cf1 req-b1d89d05-4c89-4c2d-9d35-f18241bbafa0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102031 Jan 26 19:30:57.271192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 452/883] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:30:57.484725 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:57.486591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:57.494002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:57.494520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:57.495312 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:57.495797 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:57.635694 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:57.644081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:57.645861 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:57.647016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-75a0541c-ba10-4526-a9d1-e5d2bbf8e586 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.166797 Jan 26 19:30:57.647578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 432/884] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:57 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:58.667639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:58.668304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:58.674252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:58.674694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:58.675452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:58.675914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:58.802170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:58.811126 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:58.812618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:58.813744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b9554249-0fba-4bb8-99be-a0a3bcd3d270 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.151150 Jan 26 19:30:58.814292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 453/885] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:58 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:30:59.831151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:30:59.831751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:30:59.838008 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:59.838461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:59.839235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:30:59.839667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:30:59.964695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:59.972885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:59.974385 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:30:59.975527 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-812ce8ec-f944-4910-a566-de01c642fef1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.148153 Jan 26 19:30:59.976621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 433/886] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:30:59 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:00.992914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:00.993509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:00.999686 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:01.000155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:01.000915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:01.001341 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:01.131869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:01.140659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:01.142161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:01.143300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1207d982-5f25-49fa-9793-287bf1b716d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.154080 Jan 26 19:31:01.143878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 454/887] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:00 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:02.161314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:02.161909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:02.168742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:02.169185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:02.169950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:02.170378 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:02.297822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:02.305945 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:02.307432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:02.308590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0e37e1b1-d0ce-41bb-8f1d-47237a227427 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.150998 Jan 26 19:31:02.309179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 434/888] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:02 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:03.326104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:03.326694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:03.332955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:03.333395 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:03.334152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:03.334580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:03.462252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:03.470254 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:03.471722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:03.472870 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fc70fae5-c79c-48c0-8194-f0c0bf53fde8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.150453 Jan 26 19:31:03.473426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 455/889] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:03 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:04.492034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:04.492644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:04.498834 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:04.499280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:04.500078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:04.500511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:04.625365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:04.633429 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:04.634920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:04.636097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-de511c00-af79-4acd-ae96-3a33e18fdeca tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.148360 Jan 26 19:31:04.636662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 435/890] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:04 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:05.654135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:05.654786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:05.660879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:05.661320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:05.662083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:05.662515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:05.794483 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:05.802872 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:05.805040 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:05.806202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-680a73da-b016-41e3-85c3-d008b6462762 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.155913 Jan 26 19:31:05.806751 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 456/891] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:05 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:06.825026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:06.825626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:06.831964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:06.832667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:06.833444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:06.834039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:06.992328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:07.001828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:07.003314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:07.004560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-45313e45-0c4a-45de-adcf-efdc44511f60 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1807 microversion: 2.20 time: 0.183189 Jan 26 19:31:07.005081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 436/892] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:06 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:08.021994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:08.023461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:08.029675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:08.030115 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:08.030881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:08.031308 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:08.163048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:08.171965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:08.173444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:08.174604 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8be5907b-266b-469f-b516-23b7d685ec96 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1794 microversion: 2.20 time: 0.156293 Jan 26 19:31:08.175152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 457/893] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:31:08 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:31:18.458753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:18.459261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:18.466230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:18.466678 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:18.467457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:18.467915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:18.544982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lazy-loading 'services' on Instance uuid add797ce-1fd7-4b5d-81f4-c663300f73db {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:31:18.614612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2220c8b1-a861-47da-9929-50382a3e81b8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "DELETE /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db/os-volume_attachments/11b87639-438f-4cd4-872c-9aa41998fbb0" status: 202 len: 0 microversion: 2.1 time: 0.159380 Jan 26 19:31:18.615297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 437/894] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:31:18 2022] DELETE /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db/os-volume_attachments/11b87639-438f-4cd4-872c-9aa41998fbb0 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:31:19.591683 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1158822399", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1429712429", "security_groups": [{"name": "tempest-secgroup-smoke-634496094"}], "block_device_mapping_v2": [{"uuid": "d422805d-4d77-4ed9-a835-8598711564ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "271d7cd6-39be-4683-b50e-e90ed3ff8279"}]}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:19.701638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] validate_networks() for [('271d7cd6-39be-4683-b50e-e90ed3ff8279', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:31:19.726357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:19.726929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:19.732899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:19.733345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:19.734118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:19.734554 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:19.758787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:31:19.834080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1240753c-732b-41c6-8f34-74e4a3c1c0f8 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "DELETE /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 204 len: 0 microversion: 2.1 time: 0.111693 Jan 26 19:31:19.835323 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 438/895] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:31:19 2022] DELETE /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:31:19.844004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:19.844688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:19.850877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:19.851439 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:19.852239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:19.852673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:19.979749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:19.987012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1d84ef4d-f20d-4a1c-b44e-219dda867d60 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1513 microversion: 2.1 time: 0.146918 Jan 26 19:31:19.987579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 439/896] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:19 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:31:20.063125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:31:20.063544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:31:20.064047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:31:20.064452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:31:20.064857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:31:20.073892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:20.074334 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:20.075140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:20.075572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:20.091259 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:31:20.095031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for user 477b689bf5c0415aa7eba64b81d8602a and project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:31:20.149204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:31:20.151314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d422805d-4d77-4ed9-a835-8598711564ec',volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:31:20.270500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8e270693-db92-48a6-8792-f214674afd7f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682465 Jan 26 19:31:20.271135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 458/897] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:31:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:31:20.281046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6382bb30-c5f2-4b5a-987f-796cdb8ab503 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:20.281749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6382bb30-c5f2-4b5a-987f-796cdb8ab503 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:20.332188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6382bb30-c5f2-4b5a-987f-796cdb8ab503 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:20.338788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6382bb30-c5f2-4b5a-987f-796cdb8ab503 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1095 microversion: 2.1 time: 0.061418 Jan 26 19:31:20.339361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 440/898] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:20 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:31:21.004678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:21.005307 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:21.011147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:21.011591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:21.012383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:21.012816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:21.138430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:21.145576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5f84fcfa-72a6-4799-b9c8-23b1ab323e50 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1513 microversion: 2.1 time: 0.145115 Jan 26 19:31:21.146129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 459/899] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:20 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:21.355473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:21.356310 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:21.364076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:21.364624 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:21.365507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:21.366038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:21.435139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:21.442772 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e0b8d45e-a151-42bd-a938-ced5240aed86 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1211 microversion: 2.1 time: 0.090999 Jan 26 19:31:21.443345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 441/900] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:21 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:22.163436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:22.164170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:22.171466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:22.172076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:22.173096 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:22.173630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:22.313386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:22.321471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8502bebb-3527-4c8b-b8a7-ab2e27fac864 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1513 microversion: 2.1 time: 0.162156 Jan 26 19:31:22.322053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 460/901] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:22 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:22.460631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:22.461233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:22.467222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:22.467677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:22.468490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:22.468925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:23.012820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:23.026327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-47e79b16-5a73-43cc-8476-21c48d220355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.569029 Jan 26 19:31:23.027173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 442/902] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:22 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:23.217627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-11f67cba-42b9-4578-bebd-53a27276845e req-fc5b1f27-e562-407f-889d-93d0a572a942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add797ce-1fd7-4b5d-81f4-c663300f73db", "name": "network-vif-deleted", "tag": "23655e28-0e22-4e0b-8e45-e1b3b22a2df3"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:23.220489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:31:23.220489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:31:23.229747 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-11f67cba-42b9-4578-bebd-53a27276845e req-fc5b1f27-e562-407f-889d-93d0a572a942 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:23.230324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-11f67cba-42b9-4578-bebd-53a27276845e req-fc5b1f27-e562-407f-889d-93d0a572a942 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:23.242079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-11f67cba-42b9-4578-bebd-53a27276845e req-fc5b1f27-e562-407f-889d-93d0a572a942 service nova] Creating event network-vif-deleted:23655e28-0e22-4e0b-8e45-e1b3b22a2df3 for instance add797ce-1fd7-4b5d-81f4-c663300f73db on hv-cinder-79400 Jan 26 19:31:23.249356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-11f67cba-42b9-4578-bebd-53a27276845e req-fc5b1f27-e562-407f-889d-93d0a572a942 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037403 Jan 26 19:31:23.249990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 461/903] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:31:23.338188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:23.339139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:23.345484 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:23.346418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:23.347491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:23.348111 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:23.389972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:23.390425 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:23.391066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lazy-loading 'fault' on Instance uuid add797ce-1fd7-4b5d-81f4-c663300f73db {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:31:23.470645 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d1dd6d9d0940d594152a246259a18b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8d9c9de7c8480db8e23bb4bac96785', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:23.478455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4f96b59c-96aa-40e0-8d8d-2e3c505850f9 tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 200 len: 1309 microversion: 2.1 time: 0.144595 Jan 26 19:31:23.479105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 443/904] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:23 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:24.043959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:24.044645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:24.050580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:24.051026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:24.051804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:24.052238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:24.178027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:24.185150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d183de5e-d4d0-4c6d-b37a-e221929e8069 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.145177 Jan 26 19:31:24.185730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 462/905] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:24 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:24.495500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:24.496123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] [instance: add797ce-1fd7-4b5d-81f4-c663300f73db] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:24.502269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:24.502712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:24.503476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:24.503940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:24.517567 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] HTTP exception thrown: Instance add797ce-1fd7-4b5d-81f4-c663300f73db could not be found. Jan 26 19:31:24.518244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] Returning 404 to user: Instance add797ce-1fd7-4b5d-81f4-c663300f73db could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:31:24.519042 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f3e5202d-a6b0-4ea4-b4b7-3fe2135dfd8a tempest-VolumesSnapshotTestJSON-1158495906 tempest-VolumesSnapshotTestJSON-1158495906-project] 10.222.0.50 "GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db" status: 404 len: 111 microversion: 2.1 time: 0.027793 Jan 26 19:31:24.519552 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 444/906] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:24 2022] GET /compute/v2.1/servers/add797ce-1fd7-4b5d-81f4-c663300f73db => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:31:25.200932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:25.201531 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:25.207696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:25.208168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:25.208930 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:25.209355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:25.263969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-41fd7123-d023-48d6-b4b9-fa59cd5feb5e req-e40d1b36-4792-44c3-9f9c-02563050e67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4086ab6e-4b96-40f9-bb16-220b75880976", "tag": "8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:25.265589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:31:25.265589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:31:25.272618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-41fd7123-d023-48d6-b4b9-fa59cd5feb5e req-e40d1b36-4792-44c3-9f9c-02563050e67a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:25.273318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-41fd7123-d023-48d6-b4b9-fa59cd5feb5e req-e40d1b36-4792-44c3-9f9c-02563050e67a service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:25.284431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-41fd7123-d023-48d6-b4b9-fa59cd5feb5e req-e40d1b36-4792-44c3-9f9c-02563050e67a service nova] Creating event network-changed:8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d for instance 4086ab6e-4b96-40f9-bb16-220b75880976 on hv-cinder-79400 Jan 26 19:31:25.289309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-41fd7123-d023-48d6-b4b9-fa59cd5feb5e req-e40d1b36-4792-44c3-9f9c-02563050e67a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028956 Jan 26 19:31:25.290512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 445/907] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:31:25.344538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:25.352837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-04584281-03b5-4f66-b3a0-185311b58880 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.154804 Jan 26 19:31:25.353748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 463/908] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:25 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:26.372073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:26.372789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:26.378822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:26.379293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:26.380098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:26.380523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:26.510499 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:26.517646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b102c149-05dc-4abd-917d-5b65e97c20e9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.150967 Jan 26 19:31:26.518199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 446/909] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:26 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:27.534287 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:27.534893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:27.540885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:27.541339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:27.542116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:27.542554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:27.668576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:27.675757 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-da8405c1-c16b-46f0-8eba-09dadd537c92 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.145185 Jan 26 19:31:27.676349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 464/910] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:27 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:28.692829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:28.693373 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:28.699677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:28.700161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:28.700936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:28.701374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:28.827117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:28.834406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-27ab7b3f-5f8c-4a3b-86b8-8cbaa566c6e3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.145364 Jan 26 19:31:28.835009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 447/911] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:28 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:29.850942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:29.851543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:29.857764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:29.858204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:29.858964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:29.859393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:29.984163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:29.991272 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-761edaba-4e31-4da1-97df-c752f8b023d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.144010 Jan 26 19:31:29.991847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 465/912] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:29 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:31.010155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:31.010756 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:31.016953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:31.017406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:31.018168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:31.018597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:31.149019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:31.156239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2d0f0e10-66ff-4038-861b-b9f41b430d68 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.150836 Jan 26 19:31:31.156804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 448/913] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:31 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:32.171860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:32.172463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:32.178655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:32.179103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:32.179933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:32.180692 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:32.312560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:32.319875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f14b9895-fb00-44ac-be76-4149f1e21726 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.151660 Jan 26 19:31:32.320444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 466/914] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:32 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:33.337888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:33.338594 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:33.345137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:33.345547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:33.346290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:33.346727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:33.477955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:33.485247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f11b904b-c804-45a4-a9c1-b5b7088f7400 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.151579 Jan 26 19:31:33.485817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 449/915] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:33 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:34.501661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:34.502255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:34.508432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:34.508871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:34.509630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:34.510055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:34.637194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:34.645293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c926f048-8326-4f77-ad9a-2dbb5f240d8b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.147279 Jan 26 19:31:34.646201 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 467/916] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:34 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:35.344164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-ba23b6ef-2c5f-4cb7-8240-16a856322302 req-39f6e298-c9fe-4e42-b94f-b07e676977b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4086ab6e-4b96-40f9-bb16-220b75880976", "name": "network-vif-plugged", "status": "completed", "tag": "8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:35.346417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:31:35.346417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:31:35.353809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ba23b6ef-2c5f-4cb7-8240-16a856322302 req-39f6e298-c9fe-4e42-b94f-b07e676977b2 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:35.354248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ba23b6ef-2c5f-4cb7-8240-16a856322302 req-39f6e298-c9fe-4e42-b94f-b07e676977b2 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:35.365370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-ba23b6ef-2c5f-4cb7-8240-16a856322302 req-39f6e298-c9fe-4e42-b94f-b07e676977b2 service nova] Creating event network-vif-plugged:8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d for instance 4086ab6e-4b96-40f9-bb16-220b75880976 on hv-cinder-79400 Jan 26 19:31:35.370347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-ba23b6ef-2c5f-4cb7-8240-16a856322302 req-39f6e298-c9fe-4e42-b94f-b07e676977b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030446 Jan 26 19:31:35.371113 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 450/917] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:31:35.662180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:35.662809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:35.669047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:35.669496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:35.670265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:35.670705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:35.802036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:35.810564 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c1144784-cc5c-476d-99f6-774addcf446a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.151939 Jan 26 19:31:35.811060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 468/918] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:35 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:36.827644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:36.828378 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:36.834456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:36.834905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:36.835681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:36.836142 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:36.961130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:36.968868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31200eeb-2593-4075-88f6-1d9a5196830e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.145725 Jan 26 19:31:36.969429 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 451/919] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:36 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:37.984969 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:37.985568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:37.991794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:37.992239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:37.993051 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:37.993479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:38.125007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:38.132279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fd7587c1-1b65-48ce-8a34-ca515d70b607 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.150924 Jan 26 19:31:38.132843 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 469/920] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:37 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:39.148217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:39.148822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:39.155050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:39.155498 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:39.156303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:39.156737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:39.283693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:39.291387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd29c82a-beb2-4416-af48-00d00b61edea tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.147008 Jan 26 19:31:39.291977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 452/921] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:39 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:40.307186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:40.307804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:40.314049 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:40.314485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:40.315389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:40.315984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:40.464910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:40.472063 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-99d3cef4-15a1-480d-be69-acb7f2cf3715 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1266 microversion: 2.1 time: 0.168969 Jan 26 19:31:40.472617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 470/922] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:40 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:41.488660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:41.489259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:41.495510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:41.495980 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:41.496748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:41.497175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:41.635505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:41.643317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b6496f07-5ac9-4c81-bdf7-b410bff24c94 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1454 microversion: 2.1 time: 0.158304 Jan 26 19:31:41.643984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 453/923] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:41 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:41.659544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:41.660181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:41.666433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:41.666871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:41.667631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:41.668093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:41.797478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:41.804752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-89e35d06-cbf5-444d-a853-10f1a76b99c7 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1454 microversion: 2.1 time: 0.149366 Jan 26 19:31:41.805817 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 471/924] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:41 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:43.665581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-cbf6d58b-11bb-4f89-9680-80ead20b1a9d req-484df356-9b71-4f17-b1b6-ada62b8d0a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4086ab6e-4b96-40f9-bb16-220b75880976", "tag": "8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:43.667159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:31:43.667159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:31:43.674488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cbf6d58b-11bb-4f89-9680-80ead20b1a9d req-484df356-9b71-4f17-b1b6-ada62b8d0a54 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:43.674925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cbf6d58b-11bb-4f89-9680-80ead20b1a9d req-484df356-9b71-4f17-b1b6-ada62b8d0a54 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:43.686024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-cbf6d58b-11bb-4f89-9680-80ead20b1a9d req-484df356-9b71-4f17-b1b6-ada62b8d0a54 service nova] Creating event network-changed:8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d for instance 4086ab6e-4b96-40f9-bb16-220b75880976 on hv-cinder-79400 Jan 26 19:31:43.691032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-cbf6d58b-11bb-4f89-9680-80ead20b1a9d req-484df356-9b71-4f17-b1b6-ada62b8d0a54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029547 Jan 26 19:31:43.691623 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 454/925] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:31:49.896431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:31:49.897032 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:31:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:31:54.857267 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:54.857781 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:54.863475 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:54.863971 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:54.864888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:54.865329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:54.939487 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lazy-loading 'services' on Instance uuid 2538c057-6851-449d-a4a4-bdce032a9be8 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:31:55.005067 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-72800a51-6b23-4183-9fda-9cc98392b79c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments/95233061-87a0-40d0-9d4c-fee09d5cb895" status: 202 len: 0 microversion: 2.1 time: 0.373999 Jan 26 19:31:55.005763 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 472/926] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:31:54 2022] DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments/95233061-87a0-40d0-9d4c-fee09d5cb895 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:31:56.113588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-987e36d5-acc6-4f8a-ba12-39eb7942c37a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:31:56.119590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-987e36d5-acc6-4f8a-ba12-39eb7942c37a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:56.120060 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-987e36d5-acc6-4f8a-ba12-39eb7942c37a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:56.140960 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-987e36d5-acc6-4f8a-ba12-39eb7942c37a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Going to try to stop instance {{(pid=116105) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 26 19:31:56.182334 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-987e36d5-acc6-4f8a-ba12-39eb7942c37a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 202 len: 0 microversion: 2.1 time: 0.072657 Jan 26 19:31:56.183037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 455/927] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:31:56 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:31:56.191897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:56.192582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:56.199169 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:56.199613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:56.200416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:56.200910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:56.330759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:56.338647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-45e483b0-4f44-40a1-a03e-7068d2891321 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.151315 Jan 26 19:31:56.339205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 473/928] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:56 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:57.356990 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:57.357676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:57.363754 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:57.364234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:57.365003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:57.365431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:57.495458 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:57.502626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a5ea5907-ae0f-4073-9f1a-1449c899c36a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.150727 Jan 26 19:31:57.503181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 456/929] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:57 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:58.519631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:58.520258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:58.526373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:58.526816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:58.527576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:58.528039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:58.661871 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:58.670238 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8293cca3-f2a0-4931-8843-add5fc477cc2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.154416 Jan 26 19:31:58.670797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 474/930] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:58 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:31:59.686816 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:31:59.687332 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:31:59.693600 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:59.694048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:59.694817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:31:59.695250 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:31:59.818299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:31:59.826140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-45cd0eb0-c4e3-4827-8d5d-0bcf33e7b3bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.143114 Jan 26 19:31:59.826701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 457/931] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:31:59 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:00.842900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:00.843495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:00.850065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:00.850536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:00.851299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:00.851727 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:00.975566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:00.982807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e9afa8f9-eaf0-4301-9d36-dcf70cceba05 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.143566 Jan 26 19:32:00.983363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 475/932] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:00 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:01.999001 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:01.999622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:02.005860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:02.006309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:02.007079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:02.007514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:02.133550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:02.140688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-049c56a9-47b5-40e4-a147-22f41fa22b4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.145371 Jan 26 19:32:02.141255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 458/933] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:01 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:03.157968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:03.158570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:03.165456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:03.165902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:03.166669 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:03.167102 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:03.302504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:03.309742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-31ec1819-5870-47fe-8bca-006c41ced882 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.155378 Jan 26 19:32:03.310240 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 476/934] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:03 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:04.326798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:04.327432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:04.333701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:04.334148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:04.334923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:04.335354 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:04.460646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:04.467819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-16946f85-04db-4ae3-8e60-15f904336929 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.144668 Jan 26 19:32:04.468383 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 459/935] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:04 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:05.485851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:05.486489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:05.492701 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:05.493144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:05.493909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:05.494337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:05.618579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:05.625841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7c60a764-084a-4adb-8ef8-d6d4ac4cad73 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1677 microversion: 2.1 time: 0.144195 Jan 26 19:32:05.626401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 477/936] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:05 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:06.643249 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:06.643830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:06.650803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:06.651279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:06.652067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:06.652502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:06.779437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:06.786632 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2e46d4a5-50d3-400b-9532-928deca806aa tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1654 microversion: 2.1 time: 0.147122 Jan 26 19:32:06.787236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 460/937] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:06 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:06.802472 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a6841952-9710-4cf8-ab7d-33c11ca7c0ea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:06.808861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a6841952-9710-4cf8-ab7d-33c11ca7c0ea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:06.809311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a6841952-9710-4cf8-ab7d-33c11ca7c0ea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:06.831071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a6841952-9710-4cf8-ab7d-33c11ca7c0ea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Going to try to start instance {{(pid=116106) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 26 19:32:06.871428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a6841952-9710-4cf8-ab7d-33c11ca7c0ea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action" status: 202 len: 0 microversion: 2.1 time: 0.072539 Jan 26 19:32:06.872040 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 478/938] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:32:06 2022] POST /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:32:06.879811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:06.880422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:06.886743 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:06.887230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:06.888123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:06.888663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:07.041894 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:07.049198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-143a623f-ab73-462e-b9ec-45a677d46725 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1663 microversion: 2.1 time: 0.173055 Jan 26 19:32:07.049764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 461/939] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:06 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:08.067290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:08.068015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:08.074208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:08.074757 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:08.075581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:08.076052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:08.204245 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:08.212092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9263bdd9-33d9-4a39-a6b5-a251a90a1397 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1667 microversion: 2.1 time: 0.148637 Jan 26 19:32:08.212662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 479/940] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:08 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:32:09.763479 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:09.764438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:09.770596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:09.771038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:09.771819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:09.772255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:09.841640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5e8be04e-9777-4d3b-b4b1-1a7f71285c44 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action" status: 202 len: 0 microversion: 2.1 time: 0.081655 Jan 26 19:32:09.842295 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 462/941] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:32:09 2022] POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:32:09.850015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:09.850624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:09.856933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:09.857384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:09.858164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:09.858603 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:10.002764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:10.011010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a72cfc08-69ce-4e08-a69a-412ca22aaec7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1751 microversion: 2.1 time: 0.164639 Jan 26 19:32:10.011571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 480/942] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:09 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:11.030777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:11.031462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:11.037530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:11.037973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:11.038744 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:11.039173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:11.175164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:11.182889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bbfa0ff8-af40-41b3-845f-10fa767fd28c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.156645 Jan 26 19:32:11.183445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 463/943] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:11 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:12.205772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:12.206407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:12.213229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:12.213670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:12.214436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:12.214860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:12.350845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:12.358787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7a63ec5a-2dc3-4d6e-942d-9d2073be5bbd tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.156641 Jan 26 19:32:12.359330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 481/944] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:12 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:13.375498 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:13.376271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:13.382709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:13.383670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:13.384462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:13.384890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:13.625101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:13.632856 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cb7d9611-7920-46b3-9aea-eb8c117b8ce5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.260972 Jan 26 19:32:13.634007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 464/945] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:13 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:32:14.650548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:14.651130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:14.657356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:14.657852 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:14.658638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:14.659072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:14.799550 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:14.808336 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b15a9c0e-7541-414b-848d-1cd020d1cdb7 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.162047 Jan 26 19:32:14.808914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 482/946] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:14 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:15.825568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:15.827243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:15.836458 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:15.836907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:15.837692 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:15.838129 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:15.977033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:15.984700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8c3a4ed8-eb97-4cac-a8ee-48a63ffb60f5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.163471 Jan 26 19:32:15.985265 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 465/947] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:15 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:17.001984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:17.002666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:17.009429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:17.009888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:17.010650 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:17.011081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:17.146664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:17.155264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ef1f4c86-ea17-45b9-8d67-14f0af0dbf14 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.156927 Jan 26 19:32:17.155873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 483/948] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:16 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:18.172065 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:18.172662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:18.178846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:18.179289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:18.180093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:18.180569 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:18.316670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:18.324779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-149a7b54-5c0f-43de-82a5-b9b197f777d5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.156412 Jan 26 19:32:18.325348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 466/949] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:18 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:19.341504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:19.342089 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:19.348451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:19.348916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:19.349688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:19.350116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:19.490825 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:19.498798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ac27513b-8c5a-4413-b6fb-0cf4b4ae7f4c tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.160982 Jan 26 19:32:19.499368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 484/950] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:19 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:20.516116 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:20.516719 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:20.523412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:20.523900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:20.524751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:20.525181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:20.660580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:20.669161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ddb740c-5eb1-4758-b6e7-acb409451d2d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1756 microversion: 2.1 time: 0.156746 Jan 26 19:32:20.669731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 467/951] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:20 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:21.686761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:21.687280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:21.693497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:21.693939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:21.694703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:21.695134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:21.834863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:21.842523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a7a62b97-4834-4de7-860a-4608ee87324a tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1759 microversion: 2.1 time: 0.159476 Jan 26 19:32:21.843082 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 485/952] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:32:21 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:27.889280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:27.889867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:27.895664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:27.897214 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:27.897542 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:27.898231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:27.926110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-86a9ee98-edd3-4a24-9a83-635c312f7063 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments/e3b60acb-2082-4c2c-8b74-54e64551359f" status: 200 len: 194 microversion: 2.20 time: 0.040841 Jan 26 19:32:27.926679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 468/953] 10.222.0.50 () {60 vars in 1453 bytes} [Wed Jan 26 19:32:27 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments/e3b60acb-2082-4c2c-8b74-54e64551359f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:32:27.984672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:27.985188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:27.990957 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:27.991413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:27.992209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:27.993151 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:28.069823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lazy-loading 'services' on Instance uuid a15ff6ad-b011-48d9-a8af-fc836715e6f5 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:32:28.135976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-564e7778-abb0-4ab3-ab6a-778314687ac0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments/e3b60acb-2082-4c2c-8b74-54e64551359f" status: 202 len: 0 microversion: 2.20 time: 0.155186 Jan 26 19:32:28.136657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 486/954] 10.222.0.50 () {60 vars in 1456 bytes} [Wed Jan 26 19:32:27 2022] DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments/e3b60acb-2082-4c2c-8b74-54e64551359f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:32:28.144859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:28.145782 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:28.151811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:28.152259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:28.153028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:28.153469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:28.183348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-11bb8ad0-745b-4892-bca5-3ac1c916f5e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042225 Jan 26 19:32:28.184068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 469/955] 10.222.0.50 () {60 vars in 1342 bytes} [Wed Jan 26 19:32:28 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:32:29.195056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:29.196645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:29.203108 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.203554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.204363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.204797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.232237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7916c5ad-520a-45fb-8321-0c49480c3182 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041412 Jan 26 19:32:29.232781 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 487/956] 10.222.0.50 () {60 vars in 1342 bytes} [Wed Jan 26 19:32:29 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:29.288647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:29.289170 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:29.295413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.295881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.296649 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.297075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.322372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:32:29.393311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-26e3c44d-36be-41d1-aee7-40c03b017ecd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 204 len: 0 microversion: 2.20 time: 0.108023 Jan 26 19:32:29.393997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 470/957] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Jan 26 19:32:29 2022] DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 26 19:32:29.404637 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:29.405262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:29.410968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.411419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.412223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:29.412681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:29.538316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:29.547599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:29.549190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:29.550350 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-746bf0a4-4309-4c76-be60-ef3e491fbaef tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.151735 Jan 26 19:32:29.551215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 488/958] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:29 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:30.573120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:30.573806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:30.580188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:30.580632 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:30.581405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:30.581836 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:30.712907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:30.720593 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:30.722086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:30.723247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-183ec97a-7169-443b-bc95-01d6f49bd4c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.154293 Jan 26 19:32:30.723819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 471/959] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:30 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:31.743045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:31.743796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:31.750345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:31.750789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:31.751573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:31.752031 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:31.888199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:31.896367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:31.898130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:31.899301 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f5abc18c-4f76-41bb-a1da-e237055ec526 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1722 microversion: 2.20 time: 0.160596 Jan 26 19:32:31.899900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 489/960] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:31 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:32.555443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-d1f4cb1b-1a8c-4b7a-97e2-081ba27a29a1 req-bd7ddc30-16b2-48e1-a4f0-cf8465cb4ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15ff6ad-b011-48d9-a8af-fc836715e6f5", "name": "network-vif-deleted", "tag": "fe434a86-f778-4b6d-a4b9-ab67af155876"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:32.557006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:32:32.557006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:32:32.564612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d1f4cb1b-1a8c-4b7a-97e2-081ba27a29a1 req-bd7ddc30-16b2-48e1-a4f0-cf8465cb4ab8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:32.565057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d1f4cb1b-1a8c-4b7a-97e2-081ba27a29a1 req-bd7ddc30-16b2-48e1-a4f0-cf8465cb4ab8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:32.576331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-d1f4cb1b-1a8c-4b7a-97e2-081ba27a29a1 req-bd7ddc30-16b2-48e1-a4f0-cf8465cb4ab8 service nova] Creating event network-vif-deleted:fe434a86-f778-4b6d-a4b9-ab67af155876 for instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 on hv-cinder-79400 Jan 26 19:32:32.582291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-d1f4cb1b-1a8c-4b7a-97e2-081ba27a29a1 req-bd7ddc30-16b2-48e1-a4f0-cf8465cb4ab8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Jan 26 19:32:32.583318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 472/961] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:32:32.917989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:32.919208 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:32.925694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:32.926148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:32.926928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:32.927357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:32.960244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:32.960694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:32.961689 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lazy-loading 'fault' on Instance uuid a15ff6ad-b011-48d9-a8af-fc836715e6f5 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:32:33.001466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:33.010195 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:33.011705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:33.012878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b340876f-9acb-4f49-b614-b027419fc5c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 200 len: 1371 microversion: 2.20 time: 0.099243 Jan 26 19:32:33.013432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 490/962] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:32 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:34.031210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:34.032092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:34.038385 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:34.038917 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:34.040432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:34.041098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:34.054595 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. Jan 26 19:32:34.055759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:32:34.056611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a57ebc8e-47c6-49c8-b9eb-ec830de4c87b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 404 len: 111 microversion: 2.20 time: 0.029951 Jan 26 19:32:34.057168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 473/963] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:34 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:32:34.065340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-08d55814-d899-4208-a1cb-09ad6fc0c4f1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '.version_select at 0x7fb7c0d4dd30>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:34.084614 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-08d55814-d899-4208-a1cb-09ad6fc0c4f1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448525966" status: 204 len: 0 microversion: 2.20 time: 0.022890 Jan 26 19:32:34.085190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 491/964] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Jan 26 19:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448525966 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 26 19:32:34.779973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: .version_select at 0x7fb7c0c7f280>, body: {"keypair": {"name": "tempest-keypair-284416851"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:34.794233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:32:34.797999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:32:35.235242 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:32:35.239794 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:32:35.253652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-18033a96-4ecc-4b75-8dc5-7c8d87717314 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.477525 Jan 26 19:32:35.254269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 474/965] 10.222.0.50 () {62 vars in 1198 bytes} [Wed Jan 26 19:32:34 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 479 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 26 19:32:36.523093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-683543399", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68fda3bd-90ff-4f20-8f16-b16096f575dd"}], "security_groups": [{"name": "tempest-securitygroup--1869983622"}], "key_name": "tempest-keypair-284416851", "user_data": "}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:36.620832 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.network.neutron [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] validate_networks() for [('68fda3bd-90ff-4f20-8f16-b16096f575dd', None, None, None, None, None)] {{(pid=116106) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:32:36.969696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Flavor limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:32:36.970128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Image limits 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:32:36.970606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Flavor pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:32:36.971015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Image pref 0:0:0 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:32:36.971428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.virt.hardware [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:32:36.979946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:36.980401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:36.981215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:36.981654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:36.997914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for project 200619f76ac54211847de3c39fa7c681. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:32:37.001777 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.quota [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Getting quotas for user 38f0a0c41be44b4ab34f84df6f89b14b and project 200619f76ac54211847de3c39fa7c681. Resources: {'cores', 'ram', 'instances'} {{(pid=116106) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:32:37.012921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Going to run 1 instances... {{(pid=116106) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:32:37.015218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:32:37.059800 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c073fa9e-4ced-4358-87b2-7a2250135ff1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.541589 Jan 26 19:32:37.060451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 492/966] 10.222.0.50 () {62 vars in 1187 bytes} [Wed Jan 26 19:32:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 26 19:32:37.071278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:37.071923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:37.124679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:37.131639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:37.133230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:37.134314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b6de249e-7092-416b-a8ba-92aabcd1c6c6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1280 microversion: 2.20 time: 0.067923 Jan 26 19:32:37.135235 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 475/967] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:37 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:38.152189 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:38.152798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:38.159261 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:38.159740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:38.160549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:38.160982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:38.219504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:38.228407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:38.229944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:38.231118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0a2303fd-fd50-4924-8869-dbdf575ca7a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1338 microversion: 2.20 time: 0.083568 Jan 26 19:32:38.241665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 493/968] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:38 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:39.235628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-41d9205c-1bde-4b1a-8c2b-2e2ec4556072 req-4a581c5b-ff6a-4b2b-a3f2-bffbcab767c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:39.240551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:32:39.240551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:32:39.255733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-41d9205c-1bde-4b1a-8c2b-2e2ec4556072 req-4a581c5b-ff6a-4b2b-a3f2-bffbcab767c7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:39.256347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-41d9205c-1bde-4b1a-8c2b-2e2ec4556072 req-4a581c5b-ff6a-4b2b-a3f2-bffbcab767c7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:39.258518 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:39.259256 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:39.269252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:39.269823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:39.271049 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:39.271159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-41d9205c-1bde-4b1a-8c2b-2e2ec4556072 req-4a581c5b-ff6a-4b2b-a3f2-bffbcab767c7 service nova] Creating event network-changed:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:32:39.271920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:39.282285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-41d9205c-1bde-4b1a-8c2b-2e2ec4556072 req-4a581c5b-ff6a-4b2b-a3f2-bffbcab767c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050057 Jan 26 19:32:39.282834 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 476/969] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:32:39.419043 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:39.427431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:39.429324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:39.430768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-54ec0579-cc05-4bf0-9fbf-285e2988d523 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.185417 Jan 26 19:32:39.431886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 494/970] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:39 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:40.449241 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:40.449893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:40.456435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:40.456885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:40.457664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:40.458098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:40.604901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:40.612456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:40.613940 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:40.615021 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e79786ac-9172-45ac-bc7b-4678a7c167b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.170003 Jan 26 19:32:40.615572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 477/971] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:40 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:41.632379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:41.632946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:41.639156 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:41.639597 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:41.640390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:41.640821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:41.768444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:41.776275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:41.777759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:41.778830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-93de906e-3eac-4319-8134-a67fb4cca94a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.150303 Jan 26 19:32:41.779369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 495/972] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:41 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:42.796098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:42.796723 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:42.802925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:42.803369 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:42.804183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:42.804654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:42.926718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:42.934311 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:42.935833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:42.936923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1935ce23-988e-40b9-b6aa-26d1b4c6086b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.144534 Jan 26 19:32:42.937476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 478/973] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:42 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:43.954267 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:43.954818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:43.961092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:43.961533 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:43.962293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:43.962718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:44.086719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:44.094381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:44.095921 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:44.097013 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0f260fc1-6af9-4d5a-a3b6-060a5742413b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.146544 Jan 26 19:32:44.097565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 496/974] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:43 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:45.114901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:45.115528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:45.122335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:45.122776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:45.123549 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:45.124009 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:45.254062 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:45.262255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:45.264004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:45.265157 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-495b74ec-d85f-4140-a15e-2f6cb0d45ed2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.153938 Jan 26 19:32:45.265779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 479/975] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:45 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:45.679611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-dddd82b5-6c8f-4836-b0f5-928a0d70ddef req-f003365e-ac56-4870-a8fb-a8256725e2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "name": "network-vif-plugged", "status": "completed", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:45.682011 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:32:45.682011 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:32:45.690268 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-dddd82b5-6c8f-4836-b0f5-928a0d70ddef req-f003365e-ac56-4870-a8fb-a8256725e2cc service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:45.690708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-dddd82b5-6c8f-4836-b0f5-928a0d70ddef req-f003365e-ac56-4870-a8fb-a8256725e2cc service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:45.701806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-dddd82b5-6c8f-4836-b0f5-928a0d70ddef req-f003365e-ac56-4870-a8fb-a8256725e2cc service nova] Creating event network-vif-plugged:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:32:45.706712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-dddd82b5-6c8f-4836-b0f5-928a0d70ddef req-f003365e-ac56-4870-a8fb-a8256725e2cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Jan 26 19:32:45.707288 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 497/976] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:32:46.282771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:46.283410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:46.289695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:46.290140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:46.290912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:46.291353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:46.416472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:46.424259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:46.425762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:46.426857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b8878d9-78fa-45ce-84c0-f3a89398519c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.147753 Jan 26 19:32:46.427416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 480/977] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:46 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:47.445727 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:47.447057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:47.453654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:47.454102 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:47.454869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:47.455305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:47.587813 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:47.595535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:47.597066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:47.598157 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b09313f2-eb8e-437a-8217-29f5e5bfdd48 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1406 microversion: 2.20 time: 0.157012 Jan 26 19:32:47.598715 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 498/978] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:47 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:48.616293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:48.616866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:48.623085 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:48.623528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:48.624326 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:48.624755 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:48.951761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:48.959313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:48.960829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:32:48.961985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5d706a11-495f-4e83-81c3-791c65083d62 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1597 microversion: 2.20 time: 0.349458 Jan 26 19:32:48.962533 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 481/979] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:32:48 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1597 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:32:48.979343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:32:48.980042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:48.986280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:48.986730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:48.987501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:48.987973 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:49.063711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ed24aea9-0d8c-4d95-862d-81fedd8785ee tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088550 Jan 26 19:32:49.064333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 499/980] 10.222.0.50 () {60 vars in 1315 bytes} [Wed Jan 26 19:32:48 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:32:50.190631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:50.191622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:50.192620 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-d4dc1cbc-e7f6-4267-9117-574bfe39a85c req-57583abb-193e-4563-9833-af6528f40a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:50.194242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:32:50.194242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:32:50.198202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:50.198657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:50.199418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:50.199868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:50.203414 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-d4dc1cbc-e7f6-4267-9117-574bfe39a85c req-57583abb-193e-4563-9833-af6528f40a36 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:50.203938 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-d4dc1cbc-e7f6-4267-9117-574bfe39a85c req-57583abb-193e-4563-9833-af6528f40a36 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:50.216303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-d4dc1cbc-e7f6-4267-9117-574bfe39a85c req-57583abb-193e-4563-9833-af6528f40a36 service nova] Creating event network-changed:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:32:50.221401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-d4dc1cbc-e7f6-4267-9117-574bfe39a85c req-57583abb-193e-4563-9833-af6528f40a36 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Jan 26 19:32:50.222592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 500/981] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:32:50.263158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fb2363ce-0c00-4d17-989e-e4815ecddbb9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.076220 Jan 26 19:32:50.264034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 482/982] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:50 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:32:51.276344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:51.277232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:51.283725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:51.284201 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:51.284990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:51.285419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:51.346522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8e466a23-690b-46f9-8eb1-0895b6098c8b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.075481 Jan 26 19:32:51.347644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 501/983] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:51 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:52.358829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:52.360107 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:52.366965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:52.367407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:52.368269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:52.368741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:52.429356 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-01da842f-1549-4699-a04d-e83d41e21ca3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.075291 Jan 26 19:32:52.429999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 483/984] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:52 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:53.440601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:53.441587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:53.448384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:53.448828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:53.449592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:53.450019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:53.509280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-416680af-1c51-4ca4-8311-dd0581f50ee9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.072590 Jan 26 19:32:53.509890 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 502/985] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:53 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:54.520728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:54.521726 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:54.528772 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:54.529219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:54.529995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:54.530429 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:54.594200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-49d885c3-e65a-4074-9464-96dcfec8bc05 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.077470 Jan 26 19:32:54.594787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 484/986] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:54 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:55.605006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:55.606005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:55.613127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:55.613511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:55.614280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:55.614739 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:55.680077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d9280ea9-ea8f-4467-9c8d-f8d36b39637b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.078912 Jan 26 19:32:55.681298 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 503/987] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:55 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:56.692697 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:56.693610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:56.701090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:56.701527 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:56.702316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:56.702766 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:56.763898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-125291fa-cd59-4f7d-aea0-ad31fd304c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.075201 Jan 26 19:32:56.764494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 485/988] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:56 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:57.775933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:57.776946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:57.783732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:57.784219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:57.784990 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:57.785422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:57.844548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3aa098b7-c680-49df-afe6-27efce11b282 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.073344 Jan 26 19:32:57.845141 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 504/989] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:57 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:32:58.856187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:58.857208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:58.864083 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:58.864536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:58.865347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:58.865790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:58.926169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5fb46a7e-ddf9-4a62-8ded-bcd0c8b988c4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.074457 Jan 26 19:32:58.927010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 486/990] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:58 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:32:59.937472 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:32:59.938491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:32:59.945293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:59.946252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:32:59.947021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:32:59.947457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:00.009624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c5ca0cf0-9c30-4408-8641-40f982f8b4b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 14 microversion: 2.20 time: 0.076178 Jan 26 19:33:00.010216 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 505/991] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:32:59 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:01.020830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:01.021906 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:01.029443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:01.029885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:01.030657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:01.031084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:01.110577 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f35d2bbc-a305-48b9-b138-f87c68d3fabe tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 11454 microversion: 2.20 time: 0.093680 Jan 26 19:33:01.111210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 487/992] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:01 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 11454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:02.122900 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:02.123909 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:02.130663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:02.131104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:02.131892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:02.132324 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:02.209040 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bd4dc822-ca36-454b-b459-7b7de574b5c0 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 18608 microversion: 2.20 time: 0.090061 Jan 26 19:33:02.209638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 506/993] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:02 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 18608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:03.221333 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:03.222370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:03.229781 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:03.230228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:03.231003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:03.231436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:03.299278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d9c2036e-4d3b-4174-a5a6-1b2de6416456 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 19133 microversion: 2.20 time: 0.081894 Jan 26 19:33:03.299926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 488/994] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:03 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 19133 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:04.311565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:04.312618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:04.319339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:04.319795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:04.320569 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:04.320998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:04.401135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7baaf210-6103-4b60-bc2c-5dda8a451c2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 21570 microversion: 2.20 time: 0.093451 Jan 26 19:33:04.401815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 507/995] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:04 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 21570 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:05.413131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:05.414176 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:05.421124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:05.421572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:05.422348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:05.422786 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:05.494807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-98b93abd-e78b-4597-8371-4a68b5f9f9b6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 23226 microversion: 2.20 time: 0.085682 Jan 26 19:33:05.495710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 489/996] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:05 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 23226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:06.506339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:06.507332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:06.514423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:06.514880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:06.515686 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:06.516147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:06.593262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bd37c1b2-9dd4-405e-8bef-0e896174f49a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 24473 microversion: 2.20 time: 0.090773 Jan 26 19:33:06.593810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 508/997] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:06 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 24473 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:07.605727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:07.606720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:07.613580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:07.613964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:07.614727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:07.615155 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:07.694921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e2aec7ca-4495-4f76-b683-dffab341f3b1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 25954 microversion: 2.20 time: 0.093736 Jan 26 19:33:07.695557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 490/998] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:07 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 25954 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:08.707026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:08.708054 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:08.715001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:08.715470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:08.716271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:08.716707 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:08.803582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d9c2965a-723c-4cfa-8bfe-2bc2dd85a4f3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 27133 microversion: 2.20 time: 0.100550 Jan 26 19:33:08.804377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 509/999] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:08 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 27133 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:09.815698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:09.816716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:09.823551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:09.824025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:09.824789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:09.825221 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:09.899815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5082d2a0-63f9-40dd-a285-ebd9b695a74a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 27727 microversion: 2.20 time: 0.088015 Jan 26 19:33:09.900443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 491/1000] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:09 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 27727 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:10.911756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:10.912752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:10.920065 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:10.920515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:10.921278 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:10.921709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.002626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5000c68d-e2a2-4b68-a111-887ea156c43c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28133 microversion: 2.20 time: 0.094861 Jan 26 19:33:11.003237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 510/1001] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:10 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28133 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:11.710550 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:11.712227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:11.718953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.719393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.720188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.720622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.751386 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-35267309-1055-4a4b-be50-43f314d5f481 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044841 Jan 26 19:33:11.751974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 492/1002] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:33:11 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:11.806718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:11.807326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:11.814179 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.814629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.815396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.815863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.840556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:33:11.910840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ab1a3a52-b4e0-49cd-9346-92c6a6bd6d77 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 204 len: 0 microversion: 2.1 time: 0.107751 Jan 26 19:33:11.911352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 511/1003] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:33:11 2022] DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:33:11.919911 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:11.920544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:11.926753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.927198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:11.928020 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:11.928460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:12.015342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:12.016481 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:12.022947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:12.023471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:12.024277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:12.024708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:12.054900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:12.062617 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-16bd7b8b-0f4a-470f-ac9d-66b2c506f558 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1673 microversion: 2.1 time: 0.146490 Jan 26 19:33:12.063183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 493/1004] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:11 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:33:12.104695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d028f054-a4e0-4889-a919-a3c0b29c59fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.093361 Jan 26 19:33:12.105350 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 512/1005] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:12 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:13.079268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:13.079890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:13.085979 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:13.087044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:13.087844 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:13.088283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:13.116663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:13.117666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:13.124511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:13.124980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:13.125766 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:13.126210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:13.216174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:13.223388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-feb04539-2d05-4f5b-a8c7-694d4aba59f0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1673 microversion: 2.1 time: 0.147808 Jan 26 19:33:13.224001 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 494/1006] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:13 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:13.245722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c8df943c-2381-4c79-bbc3-13f52787a75c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.133193 Jan 26 19:33:13.246573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 513/1007] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:13 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:14.058757 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-47e51307-7902-4827-9960-5afdaebc8678 req-459dd90a-c7c9-4396-b0a4-e4eddfe2b2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2538c057-6851-449d-a4a4-bdce032a9be8", "name": "network-vif-deleted", "tag": "6758173a-c05b-4dbe-a01f-d4b556f91c47"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:14.061025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:14.061025 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:33:14.071207 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-47e51307-7902-4827-9960-5afdaebc8678 req-459dd90a-c7c9-4396-b0a4-e4eddfe2b2ae service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.071656 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-47e51307-7902-4827-9960-5afdaebc8678 req-459dd90a-c7c9-4396-b0a4-e4eddfe2b2ae service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.085528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-47e51307-7902-4827-9960-5afdaebc8678 req-459dd90a-c7c9-4396-b0a4-e4eddfe2b2ae service nova] Creating event network-vif-deleted:6758173a-c05b-4dbe-a01f-d4b556f91c47 for instance 2538c057-6851-449d-a4a4-bdce032a9be8 on hv-cinder-79400 Jan 26 19:33:14.091510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-47e51307-7902-4827-9960-5afdaebc8678 req-459dd90a-c7c9-4396-b0a4-e4eddfe2b2ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036809 Jan 26 19:33:14.092737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 495/1008] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:14.240914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:14.242316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:14.251540 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.258046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:14.260192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:14.263585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.267438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.270122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.277832 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.278663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.279727 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.281011 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.344954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:14.345660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:14.346375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lazy-loading 'fault' on Instance uuid 2538c057-6851-449d-a4a4-bdce032a9be8 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:33:14.367114 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9fca73a6-8900-4a9f-a923-10adb6f278c1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.113454 Jan 26 19:33:14.369003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 496/1009] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:14 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:14.394556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:14.410740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ac206fab-76ce-478a-8def-65b82b10d865 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 200 len: 1326 microversion: 2.1 time: 0.173727 Jan 26 19:33:14.411970 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 514/1010] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:14 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:15.378943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:15.379991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:15.387375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:15.387858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:15.388640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:15.389079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:15.427553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:15.428201 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:15.434389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:15.434834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:15.435600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:15.436060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:15.451333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. Jan 26 19:33:15.452045 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:33:15.452986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4f783e35-2634-4d5d-a279-51fdb796ef41 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 404 len: 111 microversion: 2.1 time: 0.029155 Jan 26 19:33:15.453582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 515/1011] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:15 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 26 19:33:15.457125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-29c6c4ae-f1f2-4783-b2c5-67d5bcac770e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.082062 Jan 26 19:33:15.462022 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 497/1012] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:15 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:15.462193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-236fa629-f3a9-4d8d-ac25-e87d9a354d8c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '.version_select at 0x7fb7c0f8f670>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:15.478854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-236fa629-f3a9-4d8d-ac25-e87d9a354d8c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951679282" status: 202 len: 0 microversion: 2.1 time: 0.020890 Jan 26 19:33:15.479391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 516/1013] 10.222.0.50 () {58 vars in 1217 bytes} [Wed Jan 26 19:33:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951679282 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:16.171449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: .version_select at 0x7fb7c0eb2a60>, body: {"keypair": {"name": "tempest-keypair-1328681443"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:16.186648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:33:16.190427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:33:16.282691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:33:16.286340 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:33:16.299848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4fc1b2e0-82fa-4544-8f1e-697eb144d4bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.132575 Jan 26 19:33:16.300448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 498/1014] 10.222.0.50 () {60 vars in 1157 bytes} [Wed Jan 26 19:33:16 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:16.470012 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:16.470918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:16.477964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:16.478406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:16.479174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:16.479605 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:16.542918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7d9c829c-e9bc-4e08-a017-b6d29504d99a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.076063 Jan 26 19:33:16.543635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 517/1015] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:16 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:17.473735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1728339522", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a6e7ac6-67af-4ed8-a922-1c3a4f2dca5c"}], "security_groups": [{"name": "tempest-securitygroup--968206669"}], "key_name": "tempest-keypair-1328681443", "user_data": "}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:17.554840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:17.555881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:17.562997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:17.563562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:17.564465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:17.564977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:17.572314 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] validate_networks() for [('1a6e7ac6-67af-4ed8-a922-1c3a4f2dca5c', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:33:17.632891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d3639800-b6be-4a3d-8db6-065fe0fe1f89 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.081891 Jan 26 19:33:17.637295 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 518/1016] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:17 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:17.927411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:33:17.927863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:33:17.928360 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:33:17.928793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:33:17.929199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:33:17.943347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:17.943820 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:17.944675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:17.945139 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:17.961417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:33:17.965261 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Getting quotas for user 6ac79ec315b34e9fbcdf0c1727bb94d4 and project 02dc9a9d875c479c8dcb8eb1a31fa567. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:33:17.975710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:33:17.978103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:33:18.021288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [d9a2aa3c-9fb1-4869-9a01-7b9d565954a0] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 26 19:33:18.644567 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:18.645488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:18.652613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:18.653068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:18.653844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:18.654285 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:18.713844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-87dfa132-f5fb-4cc7-83b3-456eff3cc837 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.073258 Jan 26 19:33:18.714461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 519/1017] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:18 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:19.031195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [d9a2aa3c-9fb1-4869-9a01-7b9d565954a0] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47142. Jan 26 19:33:19.035057 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0cb8fe84-ba81-4aae-8518-a2cf8ffda68c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.565558 Jan 26 19:33:19.035695 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 499/1018] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:33:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:33:19.046461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5f2869ff-99a0-46e4-a65b-e103c46d6fcd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:19.047154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5f2869ff-99a0-46e4-a65b-e103c46d6fcd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:19.100901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5f2869ff-99a0-46e4-a65b-e103c46d6fcd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:19.107333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5f2869ff-99a0-46e4-a65b-e103c46d6fcd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1238 microversion: 2.1 time: 0.064816 Jan 26 19:33:19.107868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 520/1019] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:19 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:19.725702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:19.726678 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:19.732872 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:19.733317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:19.734076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:19.734504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:19.795195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6a06260-9298-4260-a43b-98ecf16f5411 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.073498 Jan 26 19:33:19.795871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 500/1020] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:19 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:20.124726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:20.125384 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:20.132356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:20.132804 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:20.133588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:20.134019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:20.198575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:20.205846 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f3c49dcb-56bb-4013-a61c-4c8665263d68 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1296 microversion: 2.1 time: 0.084944 Jan 26 19:33:20.206408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 521/1021] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:20 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:20.808109 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:20.809158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:20.816014 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:20.816462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:20.817245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:20.817679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:20.878892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a1d376f9-1053-43a2-a9a3-30a289a1492f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.075770 Jan 26 19:33:20.880748 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 501/1022] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:20 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:21.220579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-b12d3460-859d-4793-a80e-9ab57afb6304 req-29e14521-b589-42fe-b035-7d75b578c559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e423e3-0f9a-43eb-a746-10324b54c932", "tag": "c2746741-b808-4b63-8c17-d6839bcf5bb2"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:21.222332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:21.222332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:33:21.229950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:21.230640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:21.242321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-b12d3460-859d-4793-a80e-9ab57afb6304 req-29e14521-b589-42fe-b035-7d75b578c559 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:21.245069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:21.245753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-b12d3460-859d-4793-a80e-9ab57afb6304 req-29e14521-b589-42fe-b035-7d75b578c559 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:21.250084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:21.251158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:21.255481 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:21.277245 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-b12d3460-859d-4793-a80e-9ab57afb6304 req-29e14521-b589-42fe-b035-7d75b578c559 service nova] Creating event network-changed:c2746741-b808-4b63-8c17-d6839bcf5bb2 for instance 28e423e3-0f9a-43eb-a746-10324b54c932 on hv-cinder-79400 Jan 26 19:33:21.282800 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-b12d3460-859d-4793-a80e-9ab57afb6304 req-29e14521-b589-42fe-b035-7d75b578c559 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067283 Jan 26 19:33:21.287968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 522/1023] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:21.502850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:21.512729 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a5877b5-1f35-44cf-a83a-fa725a770b4a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.287400 Jan 26 19:33:21.513920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 502/1024] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:21 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:21.891470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:21.892490 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:21.899047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:21.899493 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:21.900286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:21.900720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:22.058022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0e7f21a1-e371-4f78-8167-723e6e8ec59a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.170685 Jan 26 19:33:22.063159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 523/1025] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:21 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:22.530095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:22.530702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:22.536880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:22.537330 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:22.538094 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:22.538523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:22.665160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:22.673080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1bd7f612-b876-43bf-80d8-1d4a2d1d0f1a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.146663 Jan 26 19:33:22.673638 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 503/1026] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:22 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:23.071293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:23.072829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:23.079666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:23.080211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:23.080920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:23.081357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:23.147374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-23162109-7d2a-46c6-a65a-a07a481ec0ec tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.080017 Jan 26 19:33:23.148566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 524/1027] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:23 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:23.689445 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:23.690050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:23.696290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:23.696739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:23.697512 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:23.697954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:24.023093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:24.030762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4105be85-dfdb-4a75-a46b-09c795265343 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.344973 Jan 26 19:33:24.031334 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 504/1028] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:23 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:24.160209 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:24.161205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:24.168640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:24.169088 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:24.169860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:24.170293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:24.238024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d4a28fca-7437-41a6-b211-b19741637d46 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.081824 Jan 26 19:33:24.238577 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 525/1029] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:24 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:25.047110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:25.047717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:25.053997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:25.054450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:25.055231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:25.055672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:25.178750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:25.186474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-507f6a6f-5f45-4389-b354-4110501d2a7b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.143073 Jan 26 19:33:25.187034 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 505/1030] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:25 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:25.250460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:25.251485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:25.258333 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:25.258782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:25.259555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:25.260020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:25.323966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-196360c8-71b5-4620-8a3f-f589947c76ae tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28200 microversion: 2.20 time: 0.077171 Jan 26 19:33:25.324521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 526/1031] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:25 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28200 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:26.203322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:26.203866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:26.210124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:26.210564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:26.211328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:26.211758 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:26.334976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:26.336017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:26.341515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:26.342901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:26.343362 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:26.344172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:26.344617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:26.350534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3835d9ea-5276-47b5-afe5-7dffc85bb118 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.150898 Jan 26 19:33:26.351116 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 506/1032] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:26 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:26.431280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5af87b43-4849-4429-bf78-5e4a4f46fd4a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28491 microversion: 2.20 time: 0.099716 Jan 26 19:33:26.432393 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 527/1033] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:26 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28491 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:27.366240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:27.366850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:27.373507 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:27.373956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:27.374731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:27.375167 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:27.442981 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:27.444019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:27.451351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:27.451826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:27.452623 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:27.453061 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:27.499958 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:27.507145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-84255582-885d-4ca7-b611-a84f296ea67c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.144593 Jan 26 19:33:27.507714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 507/1034] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:27 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:27.547646 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5fb83637-a713-4445-99d6-bc9989c656f8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.108524 Jan 26 19:33:27.548374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 528/1035] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:27 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:27.897450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-80ee91c3-98ef-4868-b2da-57bae7b2f942 req-c4b36243-e0d8-46ad-a274-a2dfb4203133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e423e3-0f9a-43eb-a746-10324b54c932", "name": "network-vif-plugged", "status": "completed", "tag": "c2746741-b808-4b63-8c17-d6839bcf5bb2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:27.899914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:27.899914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:33:27.908420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-80ee91c3-98ef-4868-b2da-57bae7b2f942 req-c4b36243-e0d8-46ad-a274-a2dfb4203133 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:27.908874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-80ee91c3-98ef-4868-b2da-57bae7b2f942 req-c4b36243-e0d8-46ad-a274-a2dfb4203133 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:27.919950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-80ee91c3-98ef-4868-b2da-57bae7b2f942 req-c4b36243-e0d8-46ad-a274-a2dfb4203133 service nova] Creating event network-vif-plugged:c2746741-b808-4b63-8c17-d6839bcf5bb2 for instance 28e423e3-0f9a-43eb-a746-10324b54c932 on hv-cinder-79400 Jan 26 19:33:27.924656 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-80ee91c3-98ef-4868-b2da-57bae7b2f942 req-c4b36243-e0d8-46ad-a274-a2dfb4203133 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Jan 26 19:33:27.925421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 508/1036] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:28.525403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:28.526229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:28.533074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:28.533611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:28.534379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:28.534818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:28.559860 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:28.560846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:28.567556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:28.568149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:28.569050 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:28.569486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:28.631172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a0750e35-8231-469f-89e6-7a8c490da5c7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.075308 Jan 26 19:33:28.631846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 509/1037] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:28 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:28.663241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:28.672158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1806ddd0-8ac0-4434-b2b4-70f1e579921d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1363 microversion: 2.1 time: 0.151556 Jan 26 19:33:28.672723 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 529/1038] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:28 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:29.120420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-253398764"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:29.121033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:29.127845 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.128292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.129060 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.129490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.253016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.network.security_group_api [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Removing security group c9bd21fc-ac84-46a8-b63d-25faf928ca85 from port a92f78fe-a95a-433e-ae74-1d826804d788 Jan 26 19:33:29.583483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-78906f60-eeab-480f-b619-640bf9ac0da3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action" status: 202 len: 0 microversion: 2.1 time: 0.467257 Jan 26 19:33:29.588322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 510/1039] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:29 2022] POST /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:29.591273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-2116518a-2177-41c6-825c-338ce12d3bc4 req-efb789a6-89d1-407a-8d65-29474ff3d376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:29.593309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:29.593309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:33:29.608926 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-2116518a-2177-41c6-825c-338ce12d3bc4 req-efb789a6-89d1-407a-8d65-29474ff3d376 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.609374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-2116518a-2177-41c6-825c-338ce12d3bc4 req-efb789a6-89d1-407a-8d65-29474ff3d376 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.622598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-2116518a-2177-41c6-825c-338ce12d3bc4 req-efb789a6-89d1-407a-8d65-29474ff3d376 service nova] Creating event network-changed:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:33:29.629564 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-2116518a-2177-41c6-825c-338ce12d3bc4 req-efb789a6-89d1-407a-8d65-29474ff3d376 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041497 Jan 26 19:33:29.630780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 530/1040] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:29.643815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:29.644930 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:29.655857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.656639 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.657644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.658228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.690046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:29.690751 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:29.706812 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.710578 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.714868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.715342 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.762480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ee749041-f821-42f7-94f3-c8192d2bc3dd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.122514 Jan 26 19:33:29.766350 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 511/1041] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:29 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:29.912611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:29.920995 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f04002bc-8bd7-4b4e-a32f-5994fb599937 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1549 microversion: 2.1 time: 0.235783 Jan 26 19:33:29.922173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 531/1042] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:29 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:29.939334 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:29.940993 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:29.948561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.949307 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:29.950270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:29.950863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.079120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ab43af1e-47cb-4576-90d4-a869b99fa8bb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144087 Jan 26 19:33:30.079998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 512/1043] 10.222.0.50 () {58 vars in 1274 bytes} [Wed Jan 26 19:33:29 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:30.774132 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:30.776113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:30.783044 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:30.783673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.784670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:30.785257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.822014 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:30.822549 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:30.829005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:30.829454 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.830232 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:30.830658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.863611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-50487d4d-f351-40fe-ab84-a4e2ce43f3cc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.093230 Jan 26 19:33:30.865887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 532/1044] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:30 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:30.874809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-f43e0866-88b4-4108-82f6-038c7621ec91 req-63b50567-6e58-44b1-941b-a56bcd35e200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:30.876336 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:30.876336 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:33:30.887053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-f43e0866-88b4-4108-82f6-038c7621ec91 req-63b50567-6e58-44b1-941b-a56bcd35e200 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:30.888265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-f43e0866-88b4-4108-82f6-038c7621ec91 req-63b50567-6e58-44b1-941b-a56bcd35e200 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:30.906367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-f43e0866-88b4-4108-82f6-038c7621ec91 req-63b50567-6e58-44b1-941b-a56bcd35e200 service nova] Creating event network-changed:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:33:30.913751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lazy-loading 'services' on Instance uuid 283eeb00-cb4f-420c-86c1-5b109a89420c {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:33:30.914269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-f43e0866-88b4-4108-82f6-038c7621ec91 req-63b50567-6e58-44b1-941b-a56bcd35e200 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046788 Jan 26 19:33:30.920286 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 533/1045] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:30.998852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b74e7fb1-93be-4b53-a6eb-dca8092f3cd5 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments/eebf9b41-c552-4c0a-8933-ed2e4f0c7422" status: 202 len: 0 microversion: 2.1 time: 0.181025 Jan 26 19:33:31.003294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 513/1046] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:33:30 2022] DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments/eebf9b41-c552-4c0a-8933-ed2e4f0c7422 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:31.010746 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:31.012213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:31.019682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.020738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.021762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.022458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.058725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dd9bb6c7-aa93-43f1-904a-7dca45809a0d tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053924 Jan 26 19:33:31.059743 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 534/1047] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:33:31 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:33:31.655664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-e2d2b25b-50a5-47ff-94d4-a644808e8872 req-19ba2c1d-8bb2-4366-929c-8a100f894b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e423e3-0f9a-43eb-a746-10324b54c932", "tag": "c2746741-b808-4b63-8c17-d6839bcf5bb2"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:31.657257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:31.657257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:33:31.658480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:31.662994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:31.664587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-e2d2b25b-50a5-47ff-94d4-a644808e8872 req-19ba2c1d-8bb2-4366-929c-8a100f894b7d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.665596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-e2d2b25b-50a5-47ff-94d4-a644808e8872 req-19ba2c1d-8bb2-4366-929c-8a100f894b7d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.684199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.684779 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-e2d2b25b-50a5-47ff-94d4-a644808e8872 req-19ba2c1d-8bb2-4366-929c-8a100f894b7d service nova] Creating event network-changed:c2746741-b808-4b63-8c17-d6839bcf5bb2 for instance 28e423e3-0f9a-43eb-a746-10324b54c932 on hv-cinder-79400 Jan 26 19:33:31.686972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.688351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.688475 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.692939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-e2d2b25b-50a5-47ff-94d4-a644808e8872 req-19ba2c1d-8bb2-4366-929c-8a100f894b7d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040661 Jan 26 19:33:31.693666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 535/1048] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:33:31.763253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b62dc4f7-17ed-4d72-a7c0-02b7a488dca7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.115228 Jan 26 19:33:31.764259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 514/1049] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:31 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:31.878881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:31.881423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:31.894167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.895033 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.896657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:31.897460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:31.969549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-17a361c5-606b-4275-b8a9-c3163580db67 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.097992 Jan 26 19:33:31.978855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 536/1050] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:31 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:32.073699 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:32.075355 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:32.083420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.084049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.084849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.085456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.122495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a13f1584-e5d4-4641-b644-5d3afdc30c02 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055389 Jan 26 19:33:32.127654 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 515/1051] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:33:32 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:32.133222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:32.134464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:32.141517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.142062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.143001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.143505 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.219858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] HTTP exception thrown: Instance 283eeb00-cb4f-420c-86c1-5b109a89420c is not attached to volume eebf9b41-c552-4c0a-8933-ed2e4f0c7422 Jan 26 19:33:32.220462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Returning 404 to user: Instance 283eeb00-cb4f-420c-86c1-5b109a89420c is not attached to volume eebf9b41-c552-4c0a-8933-ed2e4f0c7422 {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:33:32.221294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-110d1d78-7edf-4a29-a86d-8e5e72d591e3 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments/eebf9b41-c552-4c0a-8933-ed2e4f0c7422" status: 404 len: 154 microversion: 2.1 time: 0.092336 Jan 26 19:33:32.221841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 537/1052] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:33:32 2022] DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c/os-volume_attachments/eebf9b41-c552-4c0a-8933-ed2e4f0c7422 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 26 19:33:32.773753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:32.774925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:32.781337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.781796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.782589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.783028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.843982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-acca955e-61a2-4605-8f80-feb8a38060c4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.074034 Jan 26 19:33:32.844589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 516/1053] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:32 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:32.984875 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:32.985823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:32.992773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.993346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:32.994136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:32.994565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.051185 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8d8bdb82-9558-453a-bfb9-afc6ce3b9721 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.069840 Jan 26 19:33:33.051695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 538/1054] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:32 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:33.363362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:33.363988 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:33.370777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.371251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.372055 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.372488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.396928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:33:33.466641 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65ebabfa-a288-4190-aacb-28e74ddde461 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 204 len: 0 microversion: 2.1 time: 0.106952 Jan 26 19:33:33.467217 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 517/1055] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:33:33 2022] DELETE /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:33:33.476407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:33.477106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:33.483927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.484377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.485144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.485580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.617978 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:33.625398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8160ac99-7ac3-43ff-aaa6-f591683795ff tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1555 microversion: 2.1 time: 0.153034 Jan 26 19:33:33.625950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 539/1056] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:33 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:33.854908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:33.855932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:33.862799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.863243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.864040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:33.864471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:33.922152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a31a4ef1-e212-49ca-9bbf-aa71f1cd3ce3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.071113 Jan 26 19:33:33.922667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 518/1057] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:33 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:34.062749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:34.063660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:34.069828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.070305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:34.071095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.071546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:34.138121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f7f1c294-91e8-4716-bcac-01ac354ddd1e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.078985 Jan 26 19:33:34.138763 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 540/1058] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:34 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:34.643266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:34.643983 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:34.652023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.652473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:34.653404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.653841 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:34.788045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:34.796541 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0b07374b-8569-44f3-aecb-212db4d82024 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1555 microversion: 2.1 time: 0.157850 Jan 26 19:33:34.797145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 519/1059] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:34 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:34.933374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:34.934631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:34.941367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.941812 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:34.942570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:34.942998 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:35.004473 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-13d7b1dc-dd75-4dd0-806f-6d8c42549faf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.075142 Jan 26 19:33:35.005071 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 541/1060] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:34 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:35.151006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:35.152006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:35.158293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:35.158742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:35.159511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:35.159977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:35.224658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a5f9fa8-28b8-4747-bb9d-bd437d0b2e1f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.078152 Jan 26 19:33:35.225244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 520/1061] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:35 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:35.814503 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:35.815274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:35.822252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:35.822697 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:35.823466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:35.823962 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:35.956996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1acda2aff34d43cea680c21af6aa2053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40e0cd503f8d4553bd7dad0615823d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:35.969070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-07b9b367-1ebd-4105-8c82-5fd1541da353 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 200 len: 1555 microversion: 2.1 time: 0.159007 Jan 26 19:33:35.970410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 542/1062] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:35 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:36.015134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:36.016924 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:36.019812 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-18697b9c-0445-463d-8086-c462133ae480 req-6af45633-e595-4fa0-b85f-fcb39fb0e83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283eeb00-cb4f-420c-86c1-5b109a89420c", "name": "network-vif-deleted", "tag": "a92f78fe-a95a-433e-ae74-1d826804d788"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:36.021405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:33:36.021405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:33:36.025121 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.025583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.029396 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-18697b9c-0445-463d-8086-c462133ae480 req-6af45633-e595-4fa0-b85f-fcb39fb0e83e service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.029842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-18697b9c-0445-463d-8086-c462133ae480 req-6af45633-e595-4fa0-b85f-fcb39fb0e83e service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.036245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.036731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.041522 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-18697b9c-0445-463d-8086-c462133ae480 req-6af45633-e595-4fa0-b85f-fcb39fb0e83e service nova] Creating event network-vif-deleted:a92f78fe-a95a-433e-ae74-1d826804d788 for instance 283eeb00-cb4f-420c-86c1-5b109a89420c on hv-cinder-79400 Jan 26 19:33:36.046128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-18697b9c-0445-463d-8086-c462133ae480 req-6af45633-e595-4fa0-b85f-fcb39fb0e83e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 Jan 26 19:33:36.046894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 543/1063] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:33:36.105305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0fc31f06-fc79-42ea-a23a-97f8c61333c0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.094113 Jan 26 19:33:36.106379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 521/1064] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:36 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:36.237581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:36.238467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:36.244592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.245036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.245811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.246249 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.306902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f4af34ca-363f-4899-ae41-b631721e342d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.073748 Jan 26 19:33:36.307709 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 544/1065] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:36 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:36.986359 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:36.987051 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] [instance: 283eeb00-cb4f-420c-86c1-5b109a89420c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:36.994415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.994858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:36.995636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:36.996096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:37.010299 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] HTTP exception thrown: Instance 283eeb00-cb4f-420c-86c1-5b109a89420c could not be found. Jan 26 19:33:37.010870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Returning 404 to user: Instance 283eeb00-cb4f-420c-86c1-5b109a89420c could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:33:37.011673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ae29f744-3961-42d2-a6d6-6581b0bc7b58 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c" status: 404 len: 111 microversion: 2.1 time: 0.029431 Jan 26 19:33:37.012223 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 522/1066] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:36 2022] GET /compute/v2.1/servers/283eeb00-cb4f-420c-86c1-5b109a89420c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:33:37.020626 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-df10308a-d118-4234-aeca-1913f7861983 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] Calling method '.version_select at 0x7fb7c0ea0ca0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:37.037627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-df10308a-d118-4234-aeca-1913f7861983 tempest-TestMinimumBasicScenario-226098589 tempest-TestMinimumBasicScenario-226098589-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1778080386" status: 202 len: 0 microversion: 2.1 time: 0.020996 Jan 26 19:33:37.038159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 545/1067] 10.222.0.50 () {58 vars in 1271 bytes} [Wed Jan 26 19:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1778080386 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:37.116682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:37.117588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:37.124329 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:37.124778 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:37.125822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:37.126256 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:37.184289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-37eff133-e5e1-434c-8e0a-3a252cca7c70 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.071292 Jan 26 19:33:37.184946 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 523/1068] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:37 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:37.318891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:37.319945 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:37.327281 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:37.327732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:37.328527 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:37.328982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:37.391009 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c50f8a51-43e0-43d2-9874-8f00fb843b4f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.076020 Jan 26 19:33:37.391592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 546/1069] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:37 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:38.195007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:38.196030 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:38.202788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:38.203234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:38.204035 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:38.204467 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:38.262789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5bea509e-0e20-46e8-be2d-d324f044fe5b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.071673 Jan 26 19:33:38.263438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 524/1070] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:38 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:38.403977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:38.404896 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:38.411749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:38.412227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:38.413007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:38.413472 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:38.475678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8f0d51d9-1e4c-466e-bbbc-93b829255200 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.076288 Jan 26 19:33:38.477802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 547/1071] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:38 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:39.275520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:39.276563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:39.283706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:39.284174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:39.284971 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:39.286128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:39.353815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7fbe8a7b-037b-443f-a8dd-d053f4b766e9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.082932 Jan 26 19:33:39.355346 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 525/1072] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:39 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:39.488283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:39.489273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:39.496074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:39.496520 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:39.497291 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:39.497721 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:39.560315 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0747d70d-b9d7-4c7b-9e0c-4d1eb01dfa21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.075744 Jan 26 19:33:39.560894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 548/1073] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:39 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:40.365828 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:40.367208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:40.375291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:40.375742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:40.376591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:40.377285 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:40.437809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-19ea1cde-a41b-4067-b54e-f20467593c36 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.075896 Jan 26 19:33:40.440964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 526/1074] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:40 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:40.573164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:40.574376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:40.581724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:40.582173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:40.582972 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:40.583406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:40.649797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-747e1c7b-e6e8-408f-967d-244a352cff1d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.080103 Jan 26 19:33:40.650565 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 549/1075] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:40 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:41.449710 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:41.451457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:41.459819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:41.460276 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:41.461072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:41.461572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:41.527540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f96664ef-4d37-4d71-9546-74bacccd9a1f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 14 microversion: 2.1 time: 0.082276 Jan 26 19:33:41.528237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 527/1076] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:41 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:33:41.662428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:41.663526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:41.671630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:41.672625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:41.673469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:41.673956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:41.748025 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0e0d8197-5eec-42c2-8fe1-fcd410b02594 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.089386 Jan 26 19:33:41.748946 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 550/1077] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:41 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:42.539065 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:42.540587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:42.551709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:42.552208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:42.553005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:42.553441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:42.629123 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3937b6c7-4b63-4058-8f33-8b1f96b1139a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 2071 microversion: 2.1 time: 0.093909 Jan 26 19:33:42.629681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 528/1078] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:42 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 2071 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:42.761309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:42.762419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:42.769640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:42.770163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:42.771319 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:42.771928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:42.840744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5e45897e-7d5d-4d2f-ba55-76a8ae84e02d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.084464 Jan 26 19:33:42.841897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 551/1079] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:42 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:43.639970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:43.641240 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:43.648578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:43.649629 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:43.650551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:43.651094 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:43.726557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f45729e-1ab5-4310-8b8b-8ddd2d2ff82e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 13731 microversion: 2.1 time: 0.090611 Jan 26 19:33:43.727809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 529/1080] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:43 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 13731 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:43.854116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:43.855052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:43.861783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:43.862232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:43.863011 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:43.863445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:43.930212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6a134d90-de37-4cc4-b300-365b0eb0851a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.079991 Jan 26 19:33:43.934606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 552/1081] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:43 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:44.739039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:44.740274 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:44.747503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:44.747992 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:44.748791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:44.749211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:44.827741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e953c9c4-ed16-4e3a-baaa-22178f3786b9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 18561 microversion: 2.1 time: 0.092764 Jan 26 19:33:44.828615 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 530/1082] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:44 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 18561 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:44.943576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:44.945010 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:44.952776 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:44.953263 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:44.954098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:44.954876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.030302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e85871c2-2b96-4128-b899-f5aadefe9714 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.090715 Jan 26 19:33:45.031320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 553/1083] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:44 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:45.271866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:45.272449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:45.280415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.280865 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.281683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.282097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.308858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lazy-loading 'flavor' on Instance uuid 4d4c9802-6d78-4385-bea2-9fccff04955b {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:33:45.384877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8ef0c4c6-016e-4c50-9d48-dec00fd70099 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "POST /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b/action" status: 202 len: 0 microversion: 2.1 time: 0.117098 Jan 26 19:33:45.385528 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 531/1084] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:45 2022] POST /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:45.394290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:45.395007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:45.405037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.405954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.407657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.408391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.554281 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:45.561461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-67772de4-63e9-4d6b-af80-231dd8a0419e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.171388 Jan 26 19:33:45.562021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 554/1085] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:45 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:45.839759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:45.840788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:45.847210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.847674 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.848566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:45.848997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:45.924080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a1a2574-7e5a-492a-9f11-7b9d08bafcad tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 19342 microversion: 2.1 time: 0.088802 Jan 26 19:33:45.924629 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 532/1086] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:45 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 19342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:46.041915 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:46.042891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:46.049159 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.049606 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:46.050374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.050809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:46.114495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-83b7e1a3-1b9c-46b6-b114-be155c46aad6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.076566 Jan 26 19:33:46.115421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 555/1087] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:46 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:46.579634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:46.580377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:46.587740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.588268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:46.589059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.589487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:46.727881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:46.735208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-522dfc62-c943-4956-8d3d-0a4f61d37046 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.159603 Jan 26 19:33:46.735789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 533/1088] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:46 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:46.935571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:46.936536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:46.943298 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.943748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:46.944535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:46.944968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:47.014835 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-41c2a309-97bf-4c05-899a-0e782ddbb722 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 21972 microversion: 2.1 time: 0.083308 Jan 26 19:33:47.015446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 556/1089] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:46 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 21972 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:47.126045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:47.126950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:47.133693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:47.134154 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:47.134923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:47.135349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:47.197733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e8ca7352-14c5-49ea-9dee-26dc5a5c388c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.075138 Jan 26 19:33:47.198283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 534/1090] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:47 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:47.752643 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:47.753337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:47.760297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:47.760742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:47.761514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:47.761955 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:47.891366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:47.899255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-24d7ffe7-00e1-4eec-aa32-4ce15cfc7e00 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.150664 Jan 26 19:33:47.899830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 557/1091] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:47 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:48.026482 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:48.027481 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:48.035166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.035622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:48.036441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.036885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:48.110410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f46dcb4e-633a-4fa2-b0c4-83642281c845 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 23235 microversion: 2.1 time: 0.088726 Jan 26 19:33:48.111024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 535/1092] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:48 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 23235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:48.208160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:48.208996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:48.215786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.216241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:48.217485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.218271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:48.285607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6d6e3fa5-883e-40ed-baf8-6d3edf09ab69 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.081091 Jan 26 19:33:48.286232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 558/1093] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:48 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:48.916668 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:48.917368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:48.924279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.924737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:48.925515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:48.925950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:49.053124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:49.061473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bc59ab42-bb04-4abd-8076-e40ee969145b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.148875 Jan 26 19:33:49.062042 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 536/1094] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:48 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:49.122813 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:49.123820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:49.130654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:49.131095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:49.131885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:49.132317 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:49.204693 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1c080093-cb4e-4c49-be4a-7677d242339f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 24660 microversion: 2.1 time: 0.085747 Jan 26 19:33:49.205247 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 559/1095] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:49 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 24660 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:49.297740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:49.298652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:49.305716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:49.306162 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:49.306967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:49.307395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:49.372104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-900c9fa9-482c-4e1b-a48b-ec967a136420 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.077849 Jan 26 19:33:49.372760 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 537/1096] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:49 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:50.078782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:50.079579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:50.086932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.087381 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.088186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.088624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.217075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:50.217985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:50.223631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:50.224907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.225351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.226131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.226563 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.231595 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-13183c36-9d56-4a47-9dc3-7cc64c84b61a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.156870 Jan 26 19:33:50.232198 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 560/1097] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:50 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:50.302525 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a0857196-a910-4852-83ec-c4f3b1668f1c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 26301 microversion: 2.1 time: 0.089403 Jan 26 19:33:50.303428 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 538/1098] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:50 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 26301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:50.383859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:50.384778 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:50.391074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.391524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.392354 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:50.392790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:50.457284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cc384170-468a-422e-881b-8fc4d1bf3dfc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.077059 Jan 26 19:33:50.457930 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 561/1099] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:50 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:51.249633 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:51.250322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:51.257388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.257834 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.259190 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.259652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.314618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:51.315649 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:51.322589 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.323037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.323962 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.324400 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.394258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:51.400178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d152b91c-3c07-48b2-9caa-7c9d3c491abf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 27452 microversion: 2.1 time: 0.089434 Jan 26 19:33:51.401110 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 562/1100] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:51 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 27452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:33:51.401747 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1fac138e-ccc3-49b4-aaa8-333edefda945 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.156170 Jan 26 19:33:51.402305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 539/1101] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:51 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:51.469460 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:51.470451 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:51.477756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.478199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.478961 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:51.479392 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:51.541303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6c20a0fb-7cd4-4731-9ee7-a54d449c3b91 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.075113 Jan 26 19:33:51.541934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 563/1102] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:51 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:52.411958 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:52.412869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:52.418502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:52.419072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.419320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:52.419519 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.420328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.420764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.425482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.425920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.426681 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.427111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.503523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-74462e61-19ec-49a3-87a5-5e5d7d90bda3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 27879 microversion: 2.1 time: 0.095121 Jan 26 19:33:52.507470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 540/1103] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:52 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 27879 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:52.553464 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:52.554455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:52.556791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:52.561777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.562219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.562994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:52.563421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:52.565174 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f7542f5e-3d39-4233-bf74-6a7617741d71 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.150697 Jan 26 19:33:52.565745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 564/1104] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:52 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:33:52.629293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-272109fa-fbaf-493d-8db8-933835c5d424 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.079621 Jan 26 19:33:52.629845 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 541/1105] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:52 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:53.514893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:53.515830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:53.522057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.522766 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.523529 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.523996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.584118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:53.584831 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:53.592266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.592713 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.593490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.593921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.612833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f3c7549c-c77f-4532-b178-6c0a4b292ffe tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.101890 Jan 26 19:33:53.613568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 565/1106] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:53 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:53.641675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:53.642675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:53.650062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.650594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.652037 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:53.652480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:53.715165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b672ad9c-1070-4116-8943-14dcf24e223d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.077309 Jan 26 19:33:53.716106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 566/1107] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:53 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:53.724932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:53.732161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9180f6bd-8ba5-40f1-9a7f-2c60f3d8bd13 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.152107 Jan 26 19:33:53.732716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 542/1108] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:53 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:33:54.625607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:54.626524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:54.633325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.633771 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.634535 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.634969 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.694476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f7d23029-0a28-487a-8ca4-1d321f3ab8a9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.072913 Jan 26 19:33:54.695125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 567/1109] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:54 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:54.726666 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:54.727568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:54.734436 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.734873 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.735664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.736120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.749489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:54.750188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:54.757075 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.757529 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.758303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:54.758735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:54.797491 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5a116a65-3185-4d8a-b9ff-f3930fb7e3b4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.074364 Jan 26 19:33:54.801291 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 543/1110] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:54 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:54.886358 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:54.893929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-48557db6-84c2-4552-9920-5a2c65123932 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.148423 Jan 26 19:33:54.894488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 568/1111] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:54 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:33:55.706438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:55.707551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:55.714476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.714929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:55.715705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.716164 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:55.777851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8a1bfd6-569f-40ef-97d9-816723c43248 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.075260 Jan 26 19:33:55.778530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 544/1112] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:55 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:55.809512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:55.816251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:55.823947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.824584 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:55.825450 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.825919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:55.888891 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f2bf94ec-49fa-4a67-a866-a9e8d623aeea tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28659 microversion: 2.20 time: 0.083442 Jan 26 19:33:55.889805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 569/1113] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:55 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28659 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:55.910950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:55.911638 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:55.918950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.919397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:55.920194 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:55.920622 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:56.121195 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:56.128485 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d43cea26-7d6c-414c-9a81-d48bce896639 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.221561 Jan 26 19:33:56.129053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 545/1114] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:55 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:56.790101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:56.791103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:56.797989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:56.798440 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:56.799223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:56.799665 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:56.871412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-148b1611-9bee-40f7-942e-816dde77fd2d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.085280 Jan 26 19:33:56.872096 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 570/1115] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:56 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:33:56.900350 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:56.901248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:56.907442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:56.907929 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:56.908701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:56.909128 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:56.992006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-19649125-62b7-4170-8a83-8c55522a509f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 28813 microversion: 2.20 time: 0.095383 Jan 26 19:33:56.992859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 546/1116] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:56 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 28813 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:57.145581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:57.146178 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:57.153211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:57.153652 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:57.154413 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:57.154838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:57.287058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:57.295348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4a91ca55-321b-4bb3-bbb8-5c07a78fd83f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.153918 Jan 26 19:33:57.295929 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 571/1117] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:57 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:57.883965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:57.884892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:57.893205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:57.894029 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:57.894847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:57.895284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:57.957047 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-39211ac6-5be0-48a5-b82f-c2543731e4b0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.077111 Jan 26 19:33:57.957967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 547/1118] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:57 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:33:58.003839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:58.004775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:58.011467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.011966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.012764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.013197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.092632 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ec0e95ef-b100-405a-8a4c-8f463077c73f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 30465 microversion: 2.20 time: 0.092316 Jan 26 19:33:58.096612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 572/1119] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:57 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 30465 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 26 19:33:58.312899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:58.313592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:58.320421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.320869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.321642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.322076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.454069 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:58.461829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0462a286-49e9-408b-ad2d-707322628c05 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1570 microversion: 2.1 time: 0.153040 Jan 26 19:33:58.462400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 548/1120] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:58 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:58.478180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:58.479085 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:58.487594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.488060 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.488825 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.489257 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.579152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b481461a-b88d-4f54-9e53-882c07812bac tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "POST /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b/action" status: 202 len: 0 microversion: 2.1 time: 0.104943 Jan 26 19:33:58.580152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 573/1121] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:58 2022] POST /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:58.587833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:58.588450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:58.595846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.596474 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.597505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.598135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.733490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:58.740896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0a5a9b75-36d2-4136-8334-30a2fa2edbf7 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1518 microversion: 2.1 time: 0.156688 Jan 26 19:33:58.741452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 549/1122] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:58 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:33:58.968947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:58.969816 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:58.975616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.976124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:58.976979 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:58.977406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:59.048337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8f5e58ce-1d51-4fa5-beef-f96e758b316f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.084028 Jan 26 19:33:59.049021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 574/1123] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:33:58 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:33:59.104258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:33:59.105237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:59.111438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:59.111915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:59.112693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:59.113127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:59.200659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb3f8bee-edb3-4da9-819f-40f56e5c6adc tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 32248 microversion: 2.20 time: 0.099885 Jan 26 19:33:59.202264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 550/1124] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:33:59 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 32248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:33:59.758375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:33:59.759070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:33:59.766140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:59.766600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:59.767462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:33:59.767927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:33:59.899236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:33:59.907491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3f30b202-dcaf-410d-859b-b566949e01c2 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.153214 Jan 26 19:33:59.908090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 575/1125] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:33:59 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:00.060448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:00.061453 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:00.068419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.068874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:00.069663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.070103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:00.145004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e7b8300c-b080-423a-9ccb-4d9224bafc4c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.088459 Jan 26 19:34:00.149135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 551/1126] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:00 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:00.212582 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:00.213536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:00.220317 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.220769 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:00.221551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.221987 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:00.306202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-72e1d021-8b42-4210-bcf1-28767ff6c750 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 33312 microversion: 2.20 time: 0.097191 Jan 26 19:34:00.310337 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 576/1127] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:00 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 33312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:00.925894 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:00.926583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:00.933388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.933837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:00.934643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:00.935076 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:01.061762 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:01.069508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-789b94f4-94c8-48ee-b54a-a7d5be3b1529 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.147652 Jan 26 19:34:01.070075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 552/1128] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:00 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:01.157887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:01.158869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:01.165576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:01.166015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:01.166770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:01.167214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:01.243236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-feb3eb30-3ea0-4d36-9b6e-283fa10e0742 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.089252 Jan 26 19:34:01.243880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 577/1129] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:01 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:01.317880 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:01.318791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:01.325581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:01.326024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:01.326795 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:01.327229 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:01.530881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-00e5150d-9d7c-4c14-a17a-e890ea687803 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 34294 microversion: 2.20 time: 0.216403 Jan 26 19:34:01.531650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 553/1130] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:01 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 34294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:02.038404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-6bedfeb0-3f55-424e-91e0-ea4b6321127a req-d71e30ea-cfc9-45be-8319-78de40c9c5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "name": "network-vif-unplugged", "status": "completed", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:02.039951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:02.039951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:34:02.048514 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6bedfeb0-3f55-424e-91e0-ea4b6321127a req-d71e30ea-cfc9-45be-8319-78de40c9c5ae service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.049001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-6bedfeb0-3f55-424e-91e0-ea4b6321127a req-d71e30ea-cfc9-45be-8319-78de40c9c5ae service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.060901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-6bedfeb0-3f55-424e-91e0-ea4b6321127a req-d71e30ea-cfc9-45be-8319-78de40c9c5ae service nova] Creating event network-vif-unplugged:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:34:02.065581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-6bedfeb0-3f55-424e-91e0-ea4b6321127a req-d71e30ea-cfc9-45be-8319-78de40c9c5ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031216 Jan 26 19:34:02.066225 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 578/1131] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:34:02.086537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:02.087227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:02.094496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.094950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.095728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.096192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.223646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:02.232023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0383004d-99d4-483b-a658-5f9227a7135e tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.149469 Jan 26 19:34:02.232584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 554/1132] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:02 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:02.255194 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:02.256219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:02.262339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.262786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.263555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.264053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.327877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-df36862b-eaa8-4bb4-87eb-c51664b8b46b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.076956 Jan 26 19:34:02.328507 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 579/1133] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:02 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:02.542351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:02.543305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:02.549593 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.550038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.550823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:02.551257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:02.632480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24cd387f-4525-4385-8236-65bdfb27d027 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 35415 microversion: 2.20 time: 0.093740 Jan 26 19:34:02.633096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 555/1134] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:02 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 35415 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:03.249782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:03.250497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:03.257590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.258190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.258796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.259230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.340672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:03.341673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:03.349098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.349576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.350319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.350752 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.390677 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:03.398821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-225f0707-c105-4db4-8b47-d37d07b13cda tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.153659 Jan 26 19:34:03.399375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 580/1135] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:03 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:03.432073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8b8e3ce1-f0c1-4d82-8f4d-92bf2adc5f67 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.095658 Jan 26 19:34:03.433412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 556/1136] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:03 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:03.644702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:03.645587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:03.652579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.653021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.653788 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:03.654220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:03.729047 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1a5c7020-445d-41a6-9882-9a6bedc06de4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 36908 microversion: 2.20 time: 0.087906 Jan 26 19:34:03.730276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 581/1137] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:03 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 36908 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:04.415994 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:04.416718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:04.423520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.423995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.424779 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.425210 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.444544 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:04.445622 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:04.453029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.453479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.454244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.454676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.523133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c70bdb6c-7053-42f6-8076-b6286fffd396 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.082122 Jan 26 19:34:04.523787 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 582/1138] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:04 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:04.561040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:04.568316 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cb1230f8-931a-4244-b845-e6825dc2cf6b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.156379 Jan 26 19:34:04.568882 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 557/1139] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:04 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:04.741124 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:04.742079 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:04.749576 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.750024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.750797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:04.751231 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:04.830052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ec2f7473-370a-4ef0-a1ab-f3e9416cf7ce tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 38213 microversion: 2.20 time: 0.092966 Jan 26 19:34:04.830679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 583/1140] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:04 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 38213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:05.534916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:05.535881 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:05.542059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.542500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.543322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.543693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.585939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:05.586631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:05.594199 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.594648 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.595422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.595888 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.603408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d81de759-a8e7-4e28-aaa0-6929e016e082 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.071996 Jan 26 19:34:05.607303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 558/1141] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:05 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:05.725397 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:05.733444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4a5c1245-84f5-4592-b589-8507bfddf2a0 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.151535 Jan 26 19:34:05.734016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 584/1142] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:05 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:05.843095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:05.844133 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:05.850765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.851214 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.852024 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:05.852462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:05.913804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f5690a7b-be08-4362-b84f-318d7c6b0a76 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 38213 microversion: 2.20 time: 0.075191 Jan 26 19:34:05.914655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 559/1143] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:05 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 38213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:06.614953 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:06.615856 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:06.622098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.622554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:06.623335 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.623786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:06.685966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d7c70bfd-6523-4c0c-abfb-bc427491262a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28241 microversion: 2.1 time: 0.074617 Jan 26 19:34:06.686601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 585/1144] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:06 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:06.750591 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:06.751280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:06.758247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.758670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:06.759430 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.759884 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:06.884800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:06.892046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a9ce1072-7ea4-42db-9694-54b4dbf0eee4 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.145442 Jan 26 19:34:06.892610 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 560/1145] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:06 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:06.925459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:06.926503 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:06.933311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.933758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:06.934530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:06.934966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:07.038833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9c499b4f-43c9-4341-a1ea-acf44e891c21 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 38213 microversion: 2.20 time: 0.117361 Jan 26 19:34:07.039471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 586/1146] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:06 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 38213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:07.697395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:07.698956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:07.705238 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:07.705688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:07.706461 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:07.706897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:07.817290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-37d97408-14e6-400c-9693-8e469d5cdeb1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28532 microversion: 2.1 time: 0.123375 Jan 26 19:34:07.818634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 561/1147] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:07 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28532 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:07.911083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:07.911722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:07.918338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:07.918791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:07.919568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:07.920024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:08.051669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:08.052692 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:08.060318 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:08.060769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:08.061392 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:08.061664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:08.062283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:08.069636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-508f0bfb-866a-46d6-8f01-b24bf8fcfd9b tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.163225 Jan 26 19:34:08.070221 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 587/1148] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:07 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:08.375938 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-29ee1f41-10b7-4250-b926-f255da4a3440 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 38213 microversion: 2.20 time: 0.328559 Jan 26 19:34:08.376634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 562/1149] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:08 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 38213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:08.829394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:08.830298 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:08.836486 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:08.836971 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:08.837736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:08.838167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:08.904236 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c36ebfe4-c835-4e06-964d-8b2ec5ceb8f6 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28532 microversion: 2.1 time: 0.078378 Jan 26 19:34:08.904854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 588/1150] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:08 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28532 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:09.087581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:09.088230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:09.095562 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.096043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.096824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.097264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.224213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:09.232582 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6608dd6-2c69-49ab-8d63-859e026dbfcd tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1576 microversion: 2.1 time: 0.149121 Jan 26 19:34:09.233156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 563/1151] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:09 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:09.389025 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:09.390019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:09.396834 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.397279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.398296 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.398725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.475857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-87eb6062-317a-4df3-92b9-2ef91adbfa38 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 200 len: 38354 microversion: 2.20 time: 0.091282 Jan 26 19:34:09.476793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 589/1152] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:09 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 38354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:34:09.486328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:09.486839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:09.492968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.493421 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.494200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.494634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.517793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a055ad46-4a3c-4a3b-8d1a-51bc92ccca4b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/ips" status: 200 len: 151 microversion: 2.20 time: 0.035115 Jan 26 19:34:09.518361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 564/1153] 10.222.0.50 () {60 vars in 1288 bytes} [Wed Jan 26 19:34:09 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:09.917101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:09.918019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:09.924783 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.925230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:09.926005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:09.926443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.012865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c45e0fb9-f788-4dee-b71d-3a02c62e3527 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.099780 Jan 26 19:34:10.016837 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 590/1154] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:09 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:10.250850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:10.251449 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:10.258539 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.258981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.259742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.260198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.390026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:10.397778 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4165a8f4-9e2f-4a71-a52e-d5b8bab815e6 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1563 microversion: 2.1 time: 0.151286 Jan 26 19:34:10.398341 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 565/1155] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:10 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:10.467830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:10.468380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:10.475011 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.475452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.476241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.476671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.502807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:34:10.579005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5c7e5040-f8af-42dd-b959-5f31fb715dc6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 204 len: 0 microversion: 2.1 time: 0.115074 Jan 26 19:34:10.579542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 591/1156] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:34:10 2022] DELETE /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:34:10.587490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:10.588798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:10.594874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.595349 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.596201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:10.596642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:10.726514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:10.734394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1acf5d29-be49-46ae-bee0-af1a63680582 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1579 microversion: 2.1 time: 0.150603 Jan 26 19:34:10.734968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 566/1157] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:10 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:11.025320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:11.026954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:11.033289 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.033733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.034500 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.034928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.157082 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d187a089-2f27-4677-ab34-d482db1658f5 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.136055 Jan 26 19:34:11.157707 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 592/1158] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:11 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:11.739455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:11.740044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:11.746788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.747227 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.748027 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.748457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.751724 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:11.752442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:11.759122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.759562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.760399 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:11.760823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:11.770789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lazy-loading 'flavor' on Instance uuid 499a8ea2-3fbf-498e-9f50-70aad706252a {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:34:11.889570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:11.897328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e015e0a1-9f15-4365-a526-e301f087754f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1579 microversion: 2.1 time: 0.149495 Jan 26 19:34:11.898072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 593/1159] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:11 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1579 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:12.032842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-69e8ad8a-ce83-4935-8440-0eaa78a97d2c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 202 len: 0 microversion: 2.20 time: 0.296912 Jan 26 19:34:12.036435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 567/1160] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:11 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:34:12.042140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:12.042851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:12.049764 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.050415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.051346 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.051635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.139974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-ec28a559-c00f-40d7-8065-f1132f1b881c req-f8b329fc-5f5c-47b2-a56f-1b508f66ac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "name": "network-vif-plugged", "status": "completed", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:12.141916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:12.141916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:34:12.153453 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ec28a559-c00f-40d7-8065-f1132f1b881c req-f8b329fc-5f5c-47b2-a56f-1b508f66ac6f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.153911 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ec28a559-c00f-40d7-8065-f1132f1b881c req-f8b329fc-5f5c-47b2-a56f-1b508f66ac6f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.165537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-ec28a559-c00f-40d7-8065-f1132f1b881c req-f8b329fc-5f5c-47b2-a56f-1b508f66ac6f service nova] Creating event network-vif-plugged:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:34:12.171198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-ec28a559-c00f-40d7-8065-f1132f1b881c req-f8b329fc-5f5c-47b2-a56f-1b508f66ac6f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035199 Jan 26 19:34:12.172118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 568/1161] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:34:12.177400 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:12.178397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:12.185180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.185180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.185809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.186238 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.194328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:12.202734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:12.204556 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:12.206229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d329c0e2-a312-47c7-86fa-5f3d802b292d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.168396 Jan 26 19:34:12.217744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 594/1162] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:12 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:12.272012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0427631d-5d34-4d15-b4d1-de65b3b1cdeb tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.098244 Jan 26 19:34:12.272945 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 569/1163] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:12 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:12.914046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:12.914613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:12.921115 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.921488 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:12.922273 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:12.922737 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.060931 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:13.068753 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7519425d-24d2-4283-a333-146a84b51752 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1579 microversion: 2.1 time: 0.158328 Jan 26 19:34:13.069335 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 595/1164] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:12 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:13.225037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:13.225643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:13.232919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:13.233371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.234145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:13.234586 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.284437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:13.285408 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:13.291133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:13.292130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.292901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:13.293328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.362994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c41ac0ec-1c6f-44e8-9014-b45a548085f4 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.082121 Jan 26 19:34:13.364266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 596/1165] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:13 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:13.477741 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:13.485973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:13.487566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:13.488739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-410476a9-0f8b-4a73-8c7d-e082c06d8840 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.267953 Jan 26 19:34:13.489300 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 570/1166] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:13 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:13.633933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-91148891-aa5b-4702-afd7-bb39342be298 req-be5ef9be-5dbd-49d9-957e-5f6674e6d091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4086ab6e-4b96-40f9-bb16-220b75880976", "name": "network-vif-deleted", "tag": "8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:13.635878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:13.635878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:34:13.652496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-91148891-aa5b-4702-afd7-bb39342be298 req-be5ef9be-5dbd-49d9-957e-5f6674e6d091 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:13.653222 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-91148891-aa5b-4702-afd7-bb39342be298 req-be5ef9be-5dbd-49d9-957e-5f6674e6d091 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:13.668881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-91148891-aa5b-4702-afd7-bb39342be298 req-be5ef9be-5dbd-49d9-957e-5f6674e6d091 service nova] Creating event network-vif-deleted:8eb44e66-76ff-4e42-a5da-5ab8fcc35f6d for instance 4086ab6e-4b96-40f9-bb16-220b75880976 on hv-cinder-79400 Jan 26 19:34:13.674627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-91148891-aa5b-4702-afd7-bb39342be298 req-be5ef9be-5dbd-49d9-957e-5f6674e6d091 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044432 Jan 26 19:34:13.676168 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 597/1167] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:34:14.085623 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:14.086233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:14.093147 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.093600 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.094381 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.094821 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.126958 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.127405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.127882 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lazy-loading 'fault' on Instance uuid 4086ab6e-4b96-40f9-bb16-220b75880976 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:34:14.166043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:14.173774 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5e4781d5-cee1-433b-9fbf-12643615e9a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 200 len: 1231 microversion: 2.1 time: 0.091919 Jan 26 19:34:14.174345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 571/1168] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:14 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:14.375547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:14.376613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:14.383144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.383592 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.384428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.384862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.446180 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8247d67-145e-4650-8e96-f05d61c41ee7 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.074537 Jan 26 19:34:14.446841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 598/1169] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:14 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:14.506500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:14.507237 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:14.513653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.514228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.515313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:14.515951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:14.661041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:14.669572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:14.671129 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:14.672283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8d643bb-e5e2-4681-85c7-ea0e01f1c846 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.169652 Jan 26 19:34:14.672876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 572/1170] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:14 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:15.192035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:15.192732 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:15.199447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.199932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.200706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.201136 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.214913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] HTTP exception thrown: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. Jan 26 19:34:15.215491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Returning 404 to user: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:34:15.216325 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9c9868d1-8c06-4112-8f88-35c114494809 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 404 len: 111 microversion: 2.1 time: 0.028422 Jan 26 19:34:15.216848 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 599/1171] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:15 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:34:15.305284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1711207332", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1429712429", "security_groups": [{"name": "tempest-secgroup-smoke-634496094"}], "block_device_mapping_v2": [{"uuid": "d422805d-4d77-4ed9-a835-8598711564ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "271d7cd6-39be-4683-b50e-e90ed3ff8279"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:15.410746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] validate_networks() for [('271d7cd6-39be-4683-b50e-e90ed3ff8279', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:34:15.457984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:15.458855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:15.465749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.466187 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.466950 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.467377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.530894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ad267409-ef9f-407e-a57d-a6283088ab82 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.076499 Jan 26 19:34:15.531568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 600/1172] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:15 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:15.692144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:15.693008 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:15.703016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.703462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.704275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.704711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.783842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:34:15.784351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:34:15.784720 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:34:15.785124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:34:15.785561 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:34:15.794347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.794796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.795664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:15.796132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:15.812806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:34:15.817328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for user 477b689bf5c0415aa7eba64b81d8602a and project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:34:15.843478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:15.851716 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:15.853248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:15.854771 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-468e337a-0b66-4df5-89d0-b891d05a10b7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.166737 Jan 26 19:34:15.855303 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 601/1173] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:15 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:15.873790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:34:15.876017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d422805d-4d77-4ed9-a835-8598711564ec',volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:34:16.013750 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-de60dbed-f14a-470b-96d0-41ddb7db0062 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711997 Jan 26 19:34:16.014805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 573/1174] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:34:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:34:16.025109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7169ed3d-2450-4fc8-a0eb-30385a52190d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:16.025793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7169ed3d-2450-4fc8-a0eb-30385a52190d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:16.098768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7169ed3d-2450-4fc8-a0eb-30385a52190d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:16.106602 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7169ed3d-2450-4fc8-a0eb-30385a52190d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1095 microversion: 2.1 time: 0.085444 Jan 26 19:34:16.107510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 602/1175] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:16 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:16.542658 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:16.543788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:16.550887 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:16.551363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:16.552250 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:16.552825 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:16.628852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-86a4c2f3-175a-47ee-a57d-efaf303fbe54 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.090029 Jan 26 19:34:16.629502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 574/1176] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:16 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:16.873462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:16.874006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:16.880212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:16.880664 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:16.881443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:16.881881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:17.023076 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:17.031452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:17.032975 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:17.034143 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-147a0f44-3943-4b18-aaa4-93dee30ba24f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.165169 Jan 26 19:34:17.034695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 603/1177] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:16 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:17.122733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:17.123702 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:17.130775 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:17.131297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:17.132183 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:17.132676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:17.198048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:17.205759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-922f958f-7c7b-4f56-a03e-6d08a987ab9c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1211 microversion: 2.1 time: 0.087124 Jan 26 19:34:17.206410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 575/1178] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:17 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:17.641172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:17.642272 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:17.666618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:17.667068 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:17.667884 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:17.668311 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:17.734100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cfeed0e5-21be-40c5-82e0-2da72982d6ba tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.096726 Jan 26 19:34:17.738162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 604/1179] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:17 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:18.052672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:18.053277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:18.061103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.061834 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.062775 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.063215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.223679 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:18.225153 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:18.232467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.232910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.233676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.234102 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.266833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:18.276663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:18.279282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:18.280511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4431be01-e6a3-4b8c-9f87-638c1677228a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.231645 Jan 26 19:34:18.290810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 576/1180] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:18 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:18.356822 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-13b45f9b-276a-45df-a5ca-3f58bc049660 req-f54c5a3e-09b7-4de6-8aff-302c8a8c8e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66438316-cd90-4e4e-8b90-d7dcb5096bbf", "tag": "82e3bf1e-e1f0-4be5-9e65-ff038e41aee2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:18.362597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:18.362597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:34:18.374648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-13b45f9b-276a-45df-a5ca-3f58bc049660 req-f54c5a3e-09b7-4de6-8aff-302c8a8c8e5e service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.375606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-13b45f9b-276a-45df-a5ca-3f58bc049660 req-f54c5a3e-09b7-4de6-8aff-302c8a8c8e5e service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.389903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-13b45f9b-276a-45df-a5ca-3f58bc049660 req-f54c5a3e-09b7-4de6-8aff-302c8a8c8e5e service nova] Creating event network-changed:82e3bf1e-e1f0-4be5-9e65-ff038e41aee2 for instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf on hv-cinder-79400 Jan 26 19:34:18.396099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-13b45f9b-276a-45df-a5ca-3f58bc049660 req-f54c5a3e-09b7-4de6-8aff-302c8a8c8e5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054791 Jan 26 19:34:18.396707 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 577/1181] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:34:18.416004 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:18.424741 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-94de8fed-9d99-4141-a4d1-a0a1fe3b26db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.205119 Jan 26 19:34:18.425246 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 605/1182] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:18 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:18.746840 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:18.747883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:18.753855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.754301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.755064 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:18.755490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:18.830957 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8be2c58-14cf-427a-8e9d-4fe6ed45c918 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.088534 Jan 26 19:34:18.834986 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 578/1183] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:18 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:19.298326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:19.298851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:19.305095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.305548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.306326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.306770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.437026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:19.442719 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:19.443506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:19.444844 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:19.446379 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:19.448244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6551d641-ce83-4c1e-aab1-2446f4238c04 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.153100 Jan 26 19:34:19.448997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 606/1184] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:19 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:19.451444 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.451897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.452684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.453124 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.584761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:19.592448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d7bb3d30-f4b0-497d-ace1-b7fdd1bd00eb tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.153689 Jan 26 19:34:19.593017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 579/1185] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:19 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:19.842596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:19.843429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:19.849959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.850415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.851189 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:19.851625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:19.921548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8cd4a6ae-7678-4038-bcfd-41e9cdeccd4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.082605 Jan 26 19:34:19.922161 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 607/1186] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:19 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:20.466144 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:20.466749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:20.473187 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.473634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:20.474404 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.474858 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:20.606151 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:20.609728 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:20.610366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:20.613857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:20.615336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:20.616505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5fc727b-e2cc-4aa4-86d6-67e644b17c50 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.154089 Jan 26 19:34:20.617061 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 580/1187] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:20 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:20.617229 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.617627 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:20.618482 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.618923 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:20.755528 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:20.762785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cdb662e1-fb43-4886-9152-b13c387580d6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.157038 Jan 26 19:34:20.763349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 608/1188] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:20 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:20.932982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:20.933804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:20.939989 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.940437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:20.941199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:20.941625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:21.004148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5d065c82-1357-4e6a-92b1-c5c3d706d6c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.074814 Jan 26 19:34:21.004761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 581/1189] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:20 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:21.634279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:21.634855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:21.641887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:21.642336 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:21.643105 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:21.643534 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:21.773760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:21.778853 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:21.779549 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:21.781869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:21.783394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:21.784568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d6347ae9-5475-4584-9fdc-3952d7ab7ad3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.154073 Jan 26 19:34:21.785121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 609/1190] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:21 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:21.786336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:21.786784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:21.787554 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:21.788037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:21.918366 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:21.925979 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9066d319-ccba-4464-9828-0c10cc9f0f01 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.151135 Jan 26 19:34:21.926544 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 582/1191] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:21 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:22.015138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:22.016072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:22.022298 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.023001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:22.023791 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.024251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:22.089809 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1582d6a8-b9fc-4533-9fa7-b78e294641a8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.078223 Jan 26 19:34:22.090429 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 610/1192] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:22 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:22.802037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:22.802673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:22.808986 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.809425 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:22.810185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.810615 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:22.934652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:22.942315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:22.942760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:22.943462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:22.943817 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:22.944967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-282fc235-c375-459b-949d-5661798a721a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.146646 Jan 26 19:34:22.945513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 583/1193] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:22 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:22.950810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.951262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:22.952067 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:22.952515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:23.091255 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:23.098447 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9a8815ec-d1a4-45ab-91b4-880cc9e6be48 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.159676 Jan 26 19:34:23.098997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 611/1194] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:22 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:23.101422 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:23.102372 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:23.108606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:23.109082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:23.109854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:23.110288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:23.174135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ad59dd01-29a3-4ca3-bb17-5d37e1c731ec tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.076429 Jan 26 19:34:23.175007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 584/1195] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:23 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:23.963760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:23.964785 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:23.973501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:23.973954 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:23.974735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:23.975171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:24.104351 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:24.112072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:24.113579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:24.114735 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-69d6a22e-48b3-4360-bf1c-d7d32bc510d7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.155417 Jan 26 19:34:24.114837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:24.115297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 612/1196] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:23 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:24.115446 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:24.122273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:24.122718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:24.123487 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:24.123951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:24.185806 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:24.186712 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:24.192424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:24.192867 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:24.193632 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:24.194064 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:24.254297 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:24.256057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-69f33850-6fe7-413b-b03d-f1156c70a83c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.073698 Jan 26 19:34:24.256718 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 613/1197] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:24 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:24.264634 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8c13f0cf-9e24-4b4d-b6a8-4201ac6ccdb9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.153876 Jan 26 19:34:24.265220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 585/1198] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:24 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:25.133328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:25.134052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:25.140895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.141348 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.142125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.142560 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.266798 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:25.268248 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:25.269190 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:25.275445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:25.275668 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.276143 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.276915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.277134 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:25.277352 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.278302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8a392b7a-0d06-4668-a6e4-5d1cf11ce052 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.149125 Jan 26 19:34:25.278864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 614/1199] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:25 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:25.283167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:25.283734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:25.289586 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.290048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.290826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:25.291262 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:25.351824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7312776d-7257-41d5-ba01-a564f8c8d089 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.087147 Jan 26 19:34:25.353289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 586/1200] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:25 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:25.421193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:25.428402 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3e6be6d4-53b4-4e7c-980c-d81df3175f4a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.148593 Jan 26 19:34:25.428964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 615/1201] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:25 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:26.296706 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:26.297391 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:26.304293 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.304740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.305514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.305947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.364269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:26.365398 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:26.372193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.373358 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.374386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.374887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.434332 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:26.439886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e990fa9e-a3bb-4141-81b4-a03376e31fea tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.079021 Jan 26 19:34:26.440568 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 616/1202] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:26 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:26.445389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:26.446246 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:26.446999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:26.449093 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:26.450258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-21a9d319-5149-4443-ad8f-e3f4943debfb tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.157674 Jan 26 19:34:26.450815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 587/1203] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:26 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:26.453892 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.454340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.455108 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:26.455536 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:26.588693 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:26.595930 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2f615b03-777c-4334-abc1-16572fb64d84 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.154267 Jan 26 19:34:26.596496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 617/1204] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:26 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:27.452127 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:27.453038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:27.459270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.459721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.460534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.460965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.470588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:27.471188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:27.477839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.478280 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.479098 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.479519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.530971 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0934d387-fc44-45b4-b3f2-41b283ad71dc tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.082798 Jan 26 19:34:27.531899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 588/1205] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:27 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:27.606271 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:27.613323 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:27.614031 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:27.614188 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:27.615704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:27.616874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ae2e18fd-e33e-483e-8218-79cc8f812379 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.150084 Jan 26 19:34:27.617437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 618/1206] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:27 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:27.621483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.621935 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.622711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:27.623146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:27.750689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:27.758441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4def3826-6cf7-4d89-84f2-e6d21a09a51e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.149183 Jan 26 19:34:27.759014 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 589/1207] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:27 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:28.542417 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:28.543327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:28.549581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.550029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.550801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.551237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.618357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d01b4c0f-0b8f-4625-9438-c9a7e796381b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.080041 Jan 26 19:34:28.618931 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 619/1208] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:28 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:28.634251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:28.634951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:28.641236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.641676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.642440 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.642869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.772088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:28.775284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:28.776802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:28.780956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:28.782489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:28.783915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-90d03b61-3b0a-4e97-bf73-04add34e5645 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1743 microversion: 2.20 time: 0.153449 Jan 26 19:34:28.784057 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.784496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.784907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 590/1209] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:28 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:28.785274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:28.785899 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:28.923423 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:28.930865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1405a963-5a0d-4d7d-9742-dcd1cd769fae tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.159819 Jan 26 19:34:28.931432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 620/1210] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:28 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:34:29.630023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:29.630855 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:29.637112 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.637688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:29.638313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.638752 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:29.756396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-00e5075a-a0cb-4b25-82ad-8d8ed546d29b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.129922 Jan 26 19:34:29.757039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 591/1211] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:29 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:29.802144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:29.802745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:29.809641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.810103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:29.810860 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.811292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:29.935865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:29.943511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:29.945050 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:29.946200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1e37ec37-65c1-46dc-b106-0806c05202bd tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1743 microversion: 2.20 time: 0.147727 Jan 26 19:34:29.946758 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 621/1212] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:29 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:29.948041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:29.948737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:29.955460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.955955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:29.957088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:29.957193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:30.087598 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:30.095812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ed31305-a98e-4359-82cb-9099be855f9d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.151911 Jan 26 19:34:30.096393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 592/1213] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:29 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:30.546016 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-798a5d2b-55b3-4f1a-879f-9f437d4bd38c req-bb423380-9d63-431d-be5c-61c66fda9652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66438316-cd90-4e4e-8b90-d7dcb5096bbf", "name": "network-vif-plugged", "status": "completed", "tag": "82e3bf1e-e1f0-4be5-9e65-ff038e41aee2"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:30.547698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:30.547698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:34:30.554941 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-798a5d2b-55b3-4f1a-879f-9f437d4bd38c req-bb423380-9d63-431d-be5c-61c66fda9652 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:30.555412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-798a5d2b-55b3-4f1a-879f-9f437d4bd38c req-bb423380-9d63-431d-be5c-61c66fda9652 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:30.566714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-798a5d2b-55b3-4f1a-879f-9f437d4bd38c req-bb423380-9d63-431d-be5c-61c66fda9652 service nova] Creating event network-vif-plugged:82e3bf1e-e1f0-4be5-9e65-ff038e41aee2 for instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf on hv-cinder-79400 Jan 26 19:34:30.571465 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-798a5d2b-55b3-4f1a-879f-9f437d4bd38c req-bb423380-9d63-431d-be5c-61c66fda9652 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029374 Jan 26 19:34:30.572243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 622/1214] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:34:30.767979 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:30.769059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:30.776012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:30.776504 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:30.777288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:30.777728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:30.852970 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c99b875a-fbb2-44f8-8ec0-67d8b04dfd96 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.088395 Jan 26 19:34:30.853876 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 593/1215] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:30 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:30.965144 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:30.965833 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:30.972202 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:30.972657 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:30.973428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:30.973859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:31.098241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:31.106415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:31.107878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:31.109023 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-83a706c9-7eec-41ea-a553-1b909395067d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1743 microversion: 2.20 time: 0.147976 Jan 26 19:34:31.109579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 623/1216] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:30 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:31.112722 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:31.113437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:31.120901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:31.121343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:31.122105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:31.122533 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:31.248432 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:31.255746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-060e4088-f86f-4cb7-a4a2-f1fe5ea9fd7b tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.147122 Jan 26 19:34:31.256332 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 594/1217] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:31 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:31.864553 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:31.865463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:31.871264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:31.871714 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:31.872513 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:31.872948 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:31.947699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-17673dfc-6d5c-4fa0-aa36-3012dbb2db6b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.086731 Jan 26 19:34:31.948270 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 624/1218] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:31 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:32.126815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:32.127412 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:32.133589 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.134023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.134790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.135215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.262968 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:32.271236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:32.273019 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:32.273266 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:32.274172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e7a9471e-8acc-4a98-9bad-6da8558279fa tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1743 microversion: 2.20 time: 0.151147 Jan 26 19:34:32.274297 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:32.274925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 595/1219] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:32 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:32.281170 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.281616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.282380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.282811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.414572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:32.422858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f73dcb78-c4e4-487c-8e7d-a7c209b86e52 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1266 microversion: 2.1 time: 0.153872 Jan 26 19:34:32.423416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 625/1220] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:32 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:32.587939 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-18430edb-4875-4e27-a25d-5f635522497e req-99404584-f136-4218-b5b9-2d9776fc81f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "name": "network-vif-plugged", "status": "completed", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:32.589463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:32.589463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:34:32.597668 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-18430edb-4875-4e27-a25d-5f635522497e req-99404584-f136-4218-b5b9-2d9776fc81f8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.598109 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-18430edb-4875-4e27-a25d-5f635522497e req-99404584-f136-4218-b5b9-2d9776fc81f8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.609963 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-18430edb-4875-4e27-a25d-5f635522497e req-99404584-f136-4218-b5b9-2d9776fc81f8 service nova] Creating event network-vif-plugged:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:34:32.615870 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-18430edb-4875-4e27-a25d-5f635522497e req-99404584-f136-4218-b5b9-2d9776fc81f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 Jan 26 19:34:32.616460 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 596/1221] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:34:32.959491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:32.960549 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:32.967571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.968042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:32.968807 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:32.969237 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.040939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2e675a10-e081-4ee4-aab5-c5f4f67b1629 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.084917 Jan 26 19:34:33.041691 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 626/1222] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:32 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:33.292956 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:33.293708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:33.304915 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.305415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.306232 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.306705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.439039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:33.439952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:33.457680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.458300 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.459092 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.459530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.468896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:33.478286 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:33.479925 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:33.481735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1e8759c2-261d-4c72-9930-6e2482ee8be1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.193256 Jan 26 19:34:33.482305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 597/1223] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:33 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:33.610827 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:33.620207 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b46cd36a-75c3-427e-885e-88fb6b9352fc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1453 microversion: 2.1 time: 0.185107 Jan 26 19:34:33.620765 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 627/1224] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:33 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:33.637303 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:33.637991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:33.644655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.645179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.646030 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:33.646553 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:33.811560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:33.819244 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a760a796-4c48-4d95-96d3-0920fd67afad tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1453 microversion: 2.1 time: 0.186421 Jan 26 19:34:33.819918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 598/1225] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:34:33 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:34:34.055799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:34.057788 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:34.066873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:34.067332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:34.068165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:34.068614 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:34.151224 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eab51f2a-5540-4946-8714-36e69daed546 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.099518 Jan 26 19:34:34.151925 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 628/1226] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:34 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:34.505249 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:34.506435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:34.513374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:34.516013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:34.517785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:34.518548 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:34.961105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:34.971263 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:34.972801 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:34.973974 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-57e4b9fa-cdfc-4807-b2b2-1925b82c62a5 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.473192 Jan 26 19:34:34.974862 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 599/1227] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:34 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:35.163115 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:35.164760 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:35.172585 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:35.173319 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:35.174100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:35.174530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:35.243454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-bc997375-e104-4087-855d-b7d117620c06 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.083956 Jan 26 19:34:35.244609 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 629/1228] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:35 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:35.674577 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-d28a60c0-3fd0-4ca9-a43b-701399e306e8 req-dcbea1a3-54a3-4394-a1e8-d898ad6a4c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66438316-cd90-4e4e-8b90-d7dcb5096bbf", "tag": "82e3bf1e-e1f0-4be5-9e65-ff038e41aee2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:35.676829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:35.676829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:34:35.696287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d28a60c0-3fd0-4ca9-a43b-701399e306e8 req-dcbea1a3-54a3-4394-a1e8-d898ad6a4c47 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:35.696804 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d28a60c0-3fd0-4ca9-a43b-701399e306e8 req-dcbea1a3-54a3-4394-a1e8-d898ad6a4c47 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:35.716288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-d28a60c0-3fd0-4ca9-a43b-701399e306e8 req-dcbea1a3-54a3-4394-a1e8-d898ad6a4c47 service nova] Creating event network-changed:82e3bf1e-e1f0-4be5-9e65-ff038e41aee2 for instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf on hv-cinder-79400 Jan 26 19:34:35.723321 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-d28a60c0-3fd0-4ca9-a43b-701399e306e8 req-dcbea1a3-54a3-4394-a1e8-d898ad6a4c47 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051868 Jan 26 19:34:35.727931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 600/1229] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:34:35.998360 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:36.002538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:36.017491 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:36.018113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:36.018913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:36.019345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:36.210251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:36.219969 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:36.221799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:36.223684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-48106d69-3466-49e9-989b-1c90c37c911f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.233490 Jan 26 19:34:36.224466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 630/1230] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:35 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:36.256908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:36.258012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:36.266288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:36.266742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:36.267537 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:36.268000 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:36.336199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-97a8d863-6433-438a-b0ec-3bc3b4101877 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.083169 Jan 26 19:34:36.339840 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 601/1231] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:36 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:37.242220 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:37.242836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:37.249368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:37.249818 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:37.250601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:37.251039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:37.352644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:37.354540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:37.368434 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:37.369004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:37.369866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:37.370405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:37.402291 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:37.410912 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:37.412601 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:37.414026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1ca10fb2-5981-491c-a403-b69db856015e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.175533 Jan 26 19:34:37.414659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 631/1232] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:37 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:37.447682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6b232186-8309-4e3d-ae9b-c5711574dfa2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.102496 Jan 26 19:34:37.448853 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 602/1233] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:37 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:38.435382 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:38.435966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:38.442810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:38.443563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:38.444595 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:38.445252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:38.465682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:38.467642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:38.474909 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:38.475636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:38.476677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:38.487387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:38.560330 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-368b7d7c-f7ad-4a8c-996c-aad43902931b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.099911 Jan 26 19:34:38.565560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 603/1234] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:38 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:38.614873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:38.623992 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:38.625815 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:38.626996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e2149b39-7e2a-47dc-bc82-b86d37c8628f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.198058 Jan 26 19:34:38.627551 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 632/1235] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:38 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:39.573660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:39.574785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:39.581652 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:39.582236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:39.583126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:39.583631 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:39.644994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:39.645591 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:39.651094 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c2dc153f-3348-4b8f-af87-0ff973a2999d tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 28700 microversion: 2.1 time: 0.081335 Jan 26 19:34:39.652066 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 604/1236] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:39 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 28700 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:39.657349 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:39.658026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:39.658993 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:39.659434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:39.806005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:39.814146 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:39.816015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:39.817419 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-73f9a190-44b5-49c5-aeff-0de1032d81b2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.176227 Jan 26 19:34:39.817989 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 633/1237] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:39 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:40.663150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:40.664169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:40.672072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:40.672771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:40.673573 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:40.674014 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:40.753667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6846dfdb-6437-4a24-8316-15067c8fc6ee tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 29224 microversion: 2.1 time: 0.094437 Jan 26 19:34:40.754689 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 605/1238] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:40 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 29224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:40.834682 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:40.835290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:40.842064 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:40.842525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:40.843310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:40.843750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:40.983407 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:40.991563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:40.993321 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:40.994757 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-37a73d70-c3e8-4c9d-9d2c-5e07211543a2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.164033 Jan 26 19:34:40.995480 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 634/1239] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:40 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:41.766704 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:41.767848 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:41.775198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:41.775651 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:41.776728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:41.777866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:41.858336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-25d8da5c-0273-4ad7-8036-670c501e59dd tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 31052 microversion: 2.1 time: 0.096700 Jan 26 19:34:41.861833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 606/1240] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:41 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 31052 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:42.015795 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:42.017049 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:42.024176 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:42.024914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:42.025885 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:42.026327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:42.165706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:42.175973 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:42.178165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:42.179498 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7c902c1f-88f3-40b7-92ed-f0e707b296e2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1738 microversion: 2.20 time: 0.170125 Jan 26 19:34:42.180101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 635/1241] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:42 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:42.870854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:42.871899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:42.878774 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:42.879226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:42.880041 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:42.880469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:43.053159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-104dc3a7-c5e9-4f5d-9cd0-dafc7cbe8b2e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 32793 microversion: 2.1 time: 0.186171 Jan 26 19:34:43.053829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 607/1242] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:42 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 32793 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:43.198154 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:43.198725 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:43.205462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:43.205914 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:43.206690 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:43.207129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:43.337879 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:43.346112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:43.347644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:43.348881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e962e24f-7143-46c6-9971-3a482f7c2ebf tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1720 microversion: 2.20 time: 0.154563 Jan 26 19:34:43.355996 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 636/1243] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:43 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:44.065028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:44.066015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:44.072813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:44.073257 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:44.074017 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:44.074447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:44.145642 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cb7a0c54-c9ed-4e84-8e3f-d2e4886bf33f tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 33606 microversion: 2.1 time: 0.084480 Jan 26 19:34:44.146269 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 608/1244] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:44 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 33606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:44.366290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:44.366889 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:44.373130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:44.373571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:44.374361 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:44.374790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:44.507523 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:44.515644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:44.517165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:44.518295 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2467b138-cad2-468c-b52e-19d03f8b21e3 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1720 microversion: 2.20 time: 0.155826 Jan 26 19:34:44.518847 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 637/1245] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:44 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:45.157934 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:45.158921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:45.165734 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:45.166179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:45.166939 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:45.167368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:45.242830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1f00dd5a-8598-4703-ace6-e705e7ba2564 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 34228 microversion: 2.1 time: 0.088793 Jan 26 19:34:45.243476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 609/1246] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:45 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 34228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:45.536163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:45.536766 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:45.543015 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:45.544121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:45.544893 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:45.545327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:45.673495 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:45.681375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:45.682895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:45.684130 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7b5c3c9f-7421-4926-b9d5-183e60f650d4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1720 microversion: 2.20 time: 0.151698 Jan 26 19:34:45.684789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 638/1247] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:45 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:46.184958 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-fd7cb97e-934e-4f3a-8693-04feb3862293 req-12ca697f-5611-4564-97bb-67d0b662fd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "name": "network-vif-unplugged", "status": "completed", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:46.186584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:34:46.186584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:34:46.194619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-fd7cb97e-934e-4f3a-8693-04feb3862293 req-12ca697f-5611-4564-97bb-67d0b662fd59 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.195063 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-fd7cb97e-934e-4f3a-8693-04feb3862293 req-12ca697f-5611-4564-97bb-67d0b662fd59 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.206332 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.compute.server_external_events [req-fd7cb97e-934e-4f3a-8693-04feb3862293 req-12ca697f-5611-4564-97bb-67d0b662fd59 service nova] Unable to find a host for instance 499a8ea2-3fbf-498e-9f50-70aad706252a. Dropping event network-vif-unplugged {{(pid=116105) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 26 19:34:46.207201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-fd7cb97e-934e-4f3a-8693-04feb3862293 req-12ca697f-5611-4564-97bb-67d0b662fd59 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026453 Jan 26 19:34:46.207793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 610/1248] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 26 19:34:46.254239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:46.255147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:46.260920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.261369 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.262654 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.263113 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.348887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1dc1fa33-5fbe-4fff-8172-acd3da8b0514 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 35174 microversion: 2.1 time: 0.097924 Jan 26 19:34:46.349895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 639/1249] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:46 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 35174 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:46.702189 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:46.702853 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:46.709146 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.709588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.710352 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.710777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.845026 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:46.852564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:46.854058 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:46.855388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-03b625a3-a355-46ab-8295-ab47a4cba280 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1663 microversion: 2.20 time: 0.156992 Jan 26 19:34:46.856526 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 611/1250] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:46 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:46.874022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eff46d2f-eb25-444b-a74a-ee3141b52bc5"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:46.875149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:46.882019 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.882461 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:46.883223 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:46.883651 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.130678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c68d1ddb-28bf-4e36-9c45-78de18d3cae9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.261403 Jan 26 19:34:47.131291 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 640/1251] 10.222.0.50 () {62 vars in 1363 bytes} [Wed Jan 26 19:34:46 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments => generated 188 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:47.239451 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:47.240004 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:47.246714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.247161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.247965 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.248401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.359625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:47.360650 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:47.366942 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.367422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.368127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.368562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.443125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e5a75da1-c84b-4427-971a-5855d2d3b949 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 36220 microversion: 2.1 time: 0.087016 Jan 26 19:34:47.447466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 641/1252] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:47 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 36220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 26 19:34:47.473134 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e7861be8-8e87-4542-a88b-92faf460aab2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments/eff46d2f-eb25-444b-a74a-ee3141b52bc5" status: 202 len: 0 microversion: 2.20 time: 0.237375 Jan 26 19:34:47.473730 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 612/1253] 10.222.0.50 () {60 vars in 1456 bytes} [Wed Jan 26 19:34:47 2022] DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments/eff46d2f-eb25-444b-a74a-ee3141b52bc5 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 26 19:34:47.527410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:47.528090 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:47.534849 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.535304 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.536101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.536538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.609055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-39b13b96-e62a-4ee1-8eaa-ee47258cac0c tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action" status: 202 len: 0 microversion: 2.20 time: 0.085735 Jan 26 19:34:47.609645 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 642/1254] 10.222.0.50 () {62 vars in 1318 bytes} [Wed Jan 26 19:34:47 2022] POST /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:34:47.617606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:47.618290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:47.628405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.628914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.629789 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:47.630220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:47.760211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:47.768279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:47.769999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:47.771163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d9320c6d-302a-4e87-bbeb-e5473490de79 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1671 microversion: 2.20 time: 0.157307 Jan 26 19:34:47.771793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 613/1255] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:47 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:48.456007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:48.456948 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:48.462913 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:48.463367 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:48.464167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:48.464602 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:48.545824 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f6e358d0-9c6f-4624-8e0c-52fb5ccef7c3 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 37612 microversion: 2.1 time: 0.093684 Jan 26 19:34:48.546605 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 643/1256] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:48 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 37612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:34:48.789964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:48.791169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:48.797431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:48.797882 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:48.798666 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:48.799102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:48.998278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:49.005967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:49.007472 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:49.008659 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-411edcb0-3183-495e-a1ec-02076f7c6496 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.222413 Jan 26 19:34:49.009219 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 614/1257] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:48 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:34:49.558380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:34:49.559584 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:49.566711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:49.567525 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:49.568557 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:49.569203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:50.026497 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:50.027358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:50.035388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:50.035926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:50.036999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:50.037614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:50.178565 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:50.187564 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:50.189088 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:50.190270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e5d6d4ac-f557-4ea6-b548-8be211050a0f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.167742 Jan 26 19:34:50.190886 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 615/1258] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:50 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:51.208742 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:51.209576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:51.215596 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:51.216688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:51.217463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:51.217890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:51.350647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:51.360203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:51.361731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:51.362913 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3558b8a-e719-441d-a248-e0ab190e8384 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.157906 Jan 26 19:34:51.363637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 616/1259] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:51 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:52.380905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:52.381599 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:52.387962 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:52.388478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:52.389322 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:52.389826 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:52.518526 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:52.527292 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:52.529099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:52.530803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d4338a70-8447-46c6-9636-7fb2508259c9 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.153616 Jan 26 19:34:52.531390 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 617/1260] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:52 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:53.548938 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:53.550225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:53.567420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:53.568185 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:53.568979 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:53.569581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:53.704118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:53.714836 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:53.716526 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:53.718625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb813f8f-2c1a-46cc-ac7c-0d9981590ee8 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.173856 Jan 26 19:34:53.720117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 618/1261] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:53 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:54.736510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:54.737160 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:54.743241 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:54.743688 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:54.744503 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:54.744935 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:54.875494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:54.884463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:54.886053 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:54.887357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-37f1e5b6-92f2-476d-8712-b0326b3b0068 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.154588 Jan 26 19:34:54.898693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 619/1262] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:54 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:55.905877 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:55.906548 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:55.913002 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:55.913452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:55.914234 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:55.914693 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:56.219284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:56.229799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:56.232169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:56.234510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9e678f50-4424-4ca5-885b-6f8af7d9fb0e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.332408 Jan 26 19:34:56.235253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 620/1263] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:55 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:57.252691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:57.253452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:57.259969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:57.260426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:57.261226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:57.261662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:57.392410 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:57.400456 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:57.401959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:57.403101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2abdaaa9-d572-46f0-8aff-1914b2e4c54b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.154423 Jan 26 19:34:57.403662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 621/1264] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:57 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:58.421581 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:58.422814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:58.428985 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:58.429426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:58.430186 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:58.430613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:58.560607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:58.569251 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:58.570746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:58.571932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0396bb28-08ab-4c66-b7b0-9fc9080e7fc1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.154005 Jan 26 19:34:58.572718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 622/1265] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:58 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:34:59.590354 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:34:59.592476 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:34:59.598551 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:59.599082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:59.600074 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:34:59.600578 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:34:59.739687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:59.749228 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:59.750937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:34:59.752283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f001a035-1d60-4543-858c-565e0fe207a7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.165518 Jan 26 19:34:59.760337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 623/1266] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:34:59 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:35:00.770054 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:00.770835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:00.777203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:00.777648 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:00.778413 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:00.778840 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:00.901740 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:00.909374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:00.910863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:00.912039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4fafa3f1-13eb-4f45-880c-70cb2dd82101 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.145716 Jan 26 19:35:00.912582 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 624/1267] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:00 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:35:01.929813 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:01.930435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:01.936672 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:01.937119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:01.937897 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:01.938335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:02.068049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:02.075630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:02.077161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:02.078337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c0b4f979-b881-438d-aedb-125232dc2d09 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.152345 Jan 26 19:35:02.078892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 625/1268] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:01 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:35:03.097104 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:03.097780 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:03.103931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:03.104380 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:03.105156 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:03.105590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:03.233243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:03.241509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:03.243007 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:03.244166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3c5eb6a8-8c60-4f5d-8136-98f6743f5a12 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.150774 Jan 26 19:35:03.244726 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 626/1269] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:03 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 26 19:35:03.348013 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-af6598e1-a6ed-4673-ba06-34a9774d8c5c tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action" status: 200 len: 38364 microversion: 2.1 time: 13.793328 Jan 26 19:35:03.349922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 644/1270] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Jan 26 19:34:49 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/action => generated 38364 bytes in 13795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 26 19:35:03.358279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:03.358761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:03.365211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:03.365660 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:03.366429 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:03.366864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:03.389921 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-555012e5-f8ac-47f0-90d1-3af280171525 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/ips" status: 200 len: 145 microversion: 2.1 time: 0.035314 Jan 26 19:35:03.390500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 627/1271] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:35:03 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:04.263192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:04.263939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:04.271672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:04.272150 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:04.273184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:04.273617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:04.456823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:04.464484 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:04.465967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:04.467103 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0765b424-2398-4e28-8cd7-9f4fc27cf681 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.208093 Jan 26 19:35:04.467655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 645/1272] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:04 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:04.687926 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c8d8f79-9acf-444c-8003-aa5e368363b8"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:04.689130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:04.696072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:04.696515 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:04.697288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:04.697715 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:04.915835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-45527a1d-5887-4052-9694-6c1f15f0a435 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.231512 Jan 26 19:35:04.916582 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 628/1273] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:35:04 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 194 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:05.484006 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:05.484612 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:05.491339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:05.491841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:05.492610 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:05.493048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:05.623555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:05.631182 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:05.632705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:05.633864 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-98006ab2-2ff0-48be-b722-02d598a08ff6 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.153580 Jan 26 19:35:05.634432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 646/1274] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:05 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:06.652200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:06.652896 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:06.659348 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:06.659815 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:06.660584 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:06.661016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:06.792787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:06.801198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:06.802681 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:06.803854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-02374d0c-4269-44a2-a4c8-2628437af8a1 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.155739 Jan 26 19:35:06.804419 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 629/1275] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:06 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:07.821704 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:07.822305 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:07.828667 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:07.829116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:07.829886 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:07.830829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:07.954026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:07.962242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:07.963778 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:07.964938 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-23e3f2b1-7ff9-4f14-8033-dd82d1dac46a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.146923 Jan 26 19:35:07.965499 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 647/1276] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:07 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:08.547250 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-023b8048-0de5-4ffe-8410-fd320d6abffd req-3e0a4be1-9221-41ac-b90a-c793cbf91fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "name": "network-vif-plugged", "status": "completed", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:08.549376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:35:08.549376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:35:08.556900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-023b8048-0de5-4ffe-8410-fd320d6abffd req-3e0a4be1-9221-41ac-b90a-c793cbf91fb6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:08.557555 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-023b8048-0de5-4ffe-8410-fd320d6abffd req-3e0a4be1-9221-41ac-b90a-c793cbf91fb6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:08.569756 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-023b8048-0de5-4ffe-8410-fd320d6abffd req-3e0a4be1-9221-41ac-b90a-c793cbf91fb6 service nova] Creating event network-vif-plugged:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:35:08.574516 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-023b8048-0de5-4ffe-8410-fd320d6abffd req-3e0a4be1-9221-41ac-b90a-c793cbf91fb6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030918 Jan 26 19:35:08.575117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 630/1277] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:08.982596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:08.983198 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:08.990165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:08.990615 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:08.991402 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:08.991878 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:09.231600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:09.239830 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:09.241326 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:09.242469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-3b60b61f-41d2-4951-b25b-fc3b4d49b883 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.263640 Jan 26 19:35:09.243026 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 648/1278] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:08 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:10.261370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:10.262137 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:10.268709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:10.269150 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:10.269914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:10.270371 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:10.411103 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:10.419826 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:10.421636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:10.423045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd191fb5-7918-419a-8140-a29dafd0b653 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1729 microversion: 2.20 time: 0.166136 Jan 26 19:35:10.423829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 631/1279] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:10 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:11.441573 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:11.442258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:11.448532 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:11.449243 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:11.450165 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:11.450762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:11.582759 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:11.590479 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:11.592005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:11.593148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ba917c67-536e-4d27-a1c5-454132a8dec4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1716 microversion: 2.20 time: 0.155306 Jan 26 19:35:11.593708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 649/1280] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:35:11 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:35:12.367944 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:12.368905 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:12.375087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:12.375536 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:12.376336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:12.376770 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:12.405096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-09d93830-d2e4-4c6f-9115-23104ac2eb6a tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041148 Jan 26 19:35:12.405651 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 632/1281] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:35:12 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:12.416213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:12.416719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:12.422515 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:12.422967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:12.424436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:12.424880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:12.452876 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-25a466a6-7747-47fa-abb0-100a8e6a2442 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8" status: 200 len: 194 microversion: 2.1 time: 0.040832 Jan 26 19:35:12.453439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 650/1282] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Jan 26 19:35:12 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:13.746864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60d5eb3e-e99f-4ad4-b648-80bee97e095f"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:13.747938 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:13.754837 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:13.755284 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:13.756087 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:13.756532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:13.983452 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2839ccc8-b157-4152-a1eb-d9b8888c8d4b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240247 Jan 26 19:35:13.984101 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 633/1283] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:35:13 2022] POST /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:21.443910 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:21.444861 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:21.451000 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.451438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.452228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.452658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.481182 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d2c0a341-834e-41d1-99f3-a46b0f9bd456 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041000 Jan 26 19:35:21.481717 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 651/1284] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:35:21 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:21.704916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:21.706506 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:21.713325 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.714012 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.714948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.715547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.745339 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3cc7ee8f-6b2e-4686-b37b-4fb11dd23b26 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8" status: 200 len: 194 microversion: 2.1 time: 0.045548 Jan 26 19:35:21.750105 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 634/1285] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Jan 26 19:35:21 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:21.755111 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:21.755599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:21.762186 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.762631 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.763397 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:21.763857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:21.842368 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lazy-loading 'services' on Instance uuid 28e423e3-0f9a-43eb-a746-10324b54c932 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:35:21.913431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-860e3696-7469-4839-9f24-4e54b0f9c300 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8" status: 202 len: 0 microversion: 2.1 time: 0.161892 Jan 26 19:35:21.914106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 652/1286] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:35:21 2022] DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/0c8d8f79-9acf-444c-8003-aa5e368363b8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:35:23.020662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:23.021253 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:23.028636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:23.029287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:23.030113 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:23.030557 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:23.061443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8c6e5d76-a59d-49be-a2a0-e05ff714e5bf tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/60d5eb3e-e99f-4ad4-b648-80bee97e095f" status: 200 len: 194 microversion: 2.1 time: 0.045295 Jan 26 19:35:23.061959 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 635/1287] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Jan 26 19:35:23 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/60d5eb3e-e99f-4ad4-b648-80bee97e095f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:23.073059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:23.073639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:23.080281 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:23.080736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:23.081509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:23.081944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:23.157067 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lazy-loading 'services' on Instance uuid 28e423e3-0f9a-43eb-a746-10324b54c932 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:35:23.228618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d5f840aa-a71b-4392-9522-a16e33e2fe25 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/60d5eb3e-e99f-4ad4-b648-80bee97e095f" status: 202 len: 0 microversion: 2.1 time: 0.159919 Jan 26 19:35:23.229420 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 653/1288] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:35:23 2022] DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments/60d5eb3e-e99f-4ad4-b648-80bee97e095f => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:35:24.380049 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:24.381013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:24.387198 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.387650 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.388470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.388902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.417172 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e788cf5d-b16d-4d80-8841-0f4a5c554e18 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040831 Jan 26 19:35:24.417718 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 636/1289] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:35:24 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:35:24.514410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:24.515486 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:24.521985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.522684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.523454 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.523931 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.561059 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-456f789a-166d-4995-9d33-950c41da35c1 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050243 Jan 26 19:35:24.561476 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 654/1290] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:35:24 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:35:24.619618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:24.620135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:24.625867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.626313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.627163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.627600 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.651338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:35:24.724699 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3908391e-ab1a-4ae2-ba10-147ee52aec60 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 204 len: 0 microversion: 2.1 time: 0.108410 Jan 26 19:35:24.725457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 637/1291] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:35:24 2022] DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:35:24.733673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:24.734269 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:24.740633 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.741084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.741842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:24.742274 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:24.868000 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:24.875327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-0b449dc7-7cb0-4d78-a1ec-2ddbf6066898 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1673 microversion: 2.1 time: 0.145373 Jan 26 19:35:24.875916 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 655/1292] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:24 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:35:25.891824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:25.893149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:25.899621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:25.900098 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:25.900874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:25.901306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:26.028927 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:26.036132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ca90a1c3-ed5e-45d8-801f-bfe45d4b59d9 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1673 microversion: 2.1 time: 0.148359 Jan 26 19:35:26.036728 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 638/1293] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:25 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:35:27.053355 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:27.053956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:27.060212 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:27.060661 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:27.061438 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:27.061870 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:27.190729 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac79ec315b34e9fbcdf0c1727bb94d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dc9a9d875c479c8dcb8eb1a31fa567', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:27.198072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eadfd644-de2f-4b40-8e2c-f51207e8dcca tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 200 len: 1673 microversion: 2.1 time: 0.148452 Jan 26 19:35:27.198644 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 656/1294] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:27 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:35:27.651402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-acea88e3-8c2d-40a6-9a0d-ddddc4ec7f39 req-c65bdd76-c08a-4ae7-ab81-a281de72ec9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e423e3-0f9a-43eb-a746-10324b54c932", "name": "network-vif-deleted", "tag": "c2746741-b808-4b63-8c17-d6839bcf5bb2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:27.653010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:35:27.653010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:35:27.660759 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-acea88e3-8c2d-40a6-9a0d-ddddc4ec7f39 req-c65bdd76-c08a-4ae7-ab81-a281de72ec9f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:27.661209 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-acea88e3-8c2d-40a6-9a0d-ddddc4ec7f39 req-c65bdd76-c08a-4ae7-ab81-a281de72ec9f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:27.672901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-acea88e3-8c2d-40a6-9a0d-ddddc4ec7f39 req-c65bdd76-c08a-4ae7-ab81-a281de72ec9f service nova] Creating event network-vif-deleted:c2746741-b808-4b63-8c17-d6839bcf5bb2 for instance 28e423e3-0f9a-43eb-a746-10324b54c932 on hv-cinder-79400 Jan 26 19:35:27.678977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-acea88e3-8c2d-40a6-9a0d-ddddc4ec7f39 req-c65bdd76-c08a-4ae7-ab81-a281de72ec9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098937 Jan 26 19:35:27.679746 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 639/1295] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:28.214377 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:28.214984 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:28.221277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:28.221655 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:28.222464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:28.222897 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:28.236048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. Jan 26 19:35:28.236636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:28.237453 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-583d7ec6-e07a-45b3-81de-34204c96695b tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 404 len: 111 microversion: 2.1 time: 0.026975 Jan 26 19:35:28.237985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 657/1296] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:28 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:28.246514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7b44689e-9a7e-4e5a-8655-90e1ae3dedff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '.version_select at 0x7fb7c111de50>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:28.265366 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7b44689e-9a7e-4e5a-8655-90e1ae3dedff tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328681443" status: 202 len: 0 microversion: 2.1 time: 0.022718 Jan 26 19:35:28.265951 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 640/1297] 10.222.0.50 () {58 vars in 1220 bytes} [Wed Jan 26 19:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328681443 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:35:31.131836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:31.132343 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:31.138457 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:31.138901 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:31.139660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:31.140118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:31.153855 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. Jan 26 19:35:31.154418 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:31.155210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7345b68a-d48c-4bca-92d6-bad8872050b8 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 404 len: 111 microversion: 2.1 time: 0.027117 Jan 26 19:35:31.155720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 658/1298] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:35:31 2022] DELETE /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:31.163246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:31.164003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 28e423e3-0f9a-43eb-a746-10324b54c932] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:31.170540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:31.170991 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:31.171766 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:31.172226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:31.184932 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. Jan 26 19:35:31.185509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 28e423e3-0f9a-43eb-a746-10324b54c932 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:31.186317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8af10ace-b66c-474a-b73d-60f32e2126c2 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932" status: 404 len: 111 microversion: 2.1 time: 0.026755 Jan 26 19:35:31.186829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 641/1299] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:31 2022] GET /compute/v2.1/servers/28e423e3-0f9a-43eb-a746-10324b54c932 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:32.308596 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:32.309072 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:32.315232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:32.315676 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:32.316464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:32.316894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:32.330129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. Jan 26 19:35:32.330695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:32.331481 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-660a094b-b8c4-4dd0-a17c-14220696aaa0 tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 404 len: 111 microversion: 2.1 time: 0.026555 Jan 26 19:35:32.332027 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 659/1300] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:35:32 2022] DELETE /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:32.339417 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:32.340086 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] [instance: 2538c057-6851-449d-a4a4-bdce032a9be8] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:32.347181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:32.347628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:32.348431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:32.348866 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:32.361871 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] HTTP exception thrown: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. Jan 26 19:35:32.362443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] Returning 404 to user: Instance 2538c057-6851-449d-a4a4-bdce032a9be8 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:32.363255 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-652f3ea2-03a0-4bfc-b78f-2d47b7b0d74e tempest-AttachVolumeTestJSON-1665263945 tempest-AttachVolumeTestJSON-1665263945-project] 10.222.0.50 "GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8" status: 404 len: 111 microversion: 2.1 time: 0.027540 Jan 26 19:35:32.363823 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 642/1301] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:32 2022] GET /compute/v2.1/servers/2538c057-6851-449d-a4a4-bdce032a9be8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:36.677363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-79a4e964-eb79-473b-8263-9573c5d0f9ed tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Action: 'create', calling method: .version_select at 0x7fb7c0e82310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-821632280", "metadata": {"Type": "work"}}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:36.945163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-79a4e964-eb79-473b-8263-9573c5d0f9ed tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.376245 Jan 26 19:35:36.945911 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 660/1302] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Jan 26 19:35:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 378 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 26 19:35:36.957239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1aef5677-cb6d-420a-bba2-f182456c71e8 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c10cd3a0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:37.006489 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1aef5677-cb6d-420a-bba2-f182456c71e8 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 200 len: 352 microversion: 2.1 time: 0.053645 Jan 26 19:35:37.007077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 643/1303] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:35:36 2022] GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:35:38.019007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d2e12c1a-8f95-438a-91dd-7e684e5bbedd tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c108d0d0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:38.064282 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d2e12c1a-8f95-438a-91dd-7e684e5bbedd tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 200 len: 353 microversion: 2.1 time: 0.049288 Jan 26 19:35:38.064869 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 661/1304] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:35:38 2022] GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:38.075838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e274f853-b487-4f71-bac3-142bc6dbd99b tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c0fb8f70>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:38.120614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e274f853-b487-4f71-bac3-142bc6dbd99b tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 200 len: 353 microversion: 2.1 time: 0.048868 Jan 26 19:35:38.121161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 644/1305] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:35:38 2022] GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:38.136548 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f839c80e-eb75-4e15-a9a0-1da59662833d tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c1073c10>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:38.193401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f839c80e-eb75-4e15-a9a0-1da59662833d tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 202 len: 0 microversion: 2.1 time: 0.060261 Jan 26 19:35:38.194446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 662/1306] 10.222.0.50 () {58 vars in 1247 bytes} [Wed Jan 26 19:35:38 2022] DELETE /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:35:38.202687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-14e5b25a-517c-4950-b267-8f2e769bf592 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c0e54a60>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:38.248118 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-14e5b25a-517c-4950-b267-8f2e769bf592 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 200 len: 352 microversion: 2.1 time: 0.049264 Jan 26 19:35:38.248684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 645/1307] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:35:38 2022] GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:35:39.262149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1e253faf-8013-4099-8f95-b2b09f84f2e0 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Calling method '.version_select at 0x7fb7c0ea0280>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:39.292854 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-1e253faf-8013-4099-8f95-b2b09f84f2e0 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] HTTP exception thrown: Volume b238cf22-566a-4e64-ada8-58f31abbbe91 could not be found. Jan 26 19:35:39.293435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1e253faf-8013-4099-8f95-b2b09f84f2e0 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] Returning 404 to user: Volume b238cf22-566a-4e64-ada8-58f31abbbe91 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:39.294250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1e253faf-8013-4099-8f95-b2b09f84f2e0 tempest-VolumesGetTestJSON-238837520 tempest-VolumesGetTestJSON-238837520-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91" status: 404 len: 109 microversion: 2.1 time: 0.038030 Jan 26 19:35:39.294779 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 663/1308] 10.222.0.50 () {58 vars in 1244 bytes} [Wed Jan 26 19:35:39 2022] GET /compute/v2.1/os-volumes/b238cf22-566a-4e64-ada8-58f31abbbe91 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:50.745480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:50.746038 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:50.752362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:50.753001 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:50.753998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:50.754435 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:50.781879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:35:50.887543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-ed7a5178-cbc7-41df-b135-a9bb88e7ed8a req-274c39b1-2833-44a1-ab7c-f685dd96391d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:50.889077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:35:50.889077 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:35:50.895099 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-21571865-0896-42f7-9044-9157382dd90f tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 204 len: 0 microversion: 2.1 time: 0.154783 Jan 26 19:35:50.895818 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 646/1309] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:35:50 2022] DELETE /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:35:50.897559 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-ed7a5178-cbc7-41df-b135-a9bb88e7ed8a req-274c39b1-2833-44a1-ab7c-f685dd96391d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:50.898007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-ed7a5178-cbc7-41df-b135-a9bb88e7ed8a req-274c39b1-2833-44a1-ab7c-f685dd96391d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:50.903987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:50.904673 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:50.909790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-ed7a5178-cbc7-41df-b135-a9bb88e7ed8a req-274c39b1-2833-44a1-ab7c-f685dd96391d service nova] Creating event network-changed:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:35:50.910415 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:50.910859 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:50.911627 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:50.912080 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:50.914797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-ed7a5178-cbc7-41df-b135-a9bb88e7ed8a req-274c39b1-2833-44a1-ab7c-f685dd96391d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171096 Jan 26 19:35:50.915386 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 664/1310] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:35:51.070523 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:51.078462 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b51f5029-aab0-48eb-ba92-40607814a02a tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1569 microversion: 2.1 time: 0.178288 Jan 26 19:35:51.079067 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 647/1311] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:50 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:35:52.096747 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:52.097446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:52.103744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:52.104279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:52.105138 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:52.105587 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:52.243719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:52.251425 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e4e1c93f-56f6-4aa8-9cf6-586d33134667 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1451 microversion: 2.1 time: 0.159840 Jan 26 19:35:52.252022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 665/1312] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:52 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:35:53.268900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:53.269609 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:53.275829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:53.276381 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:53.277179 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:53.277597 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:53.380262 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac82831a8435454aae7a7669764bb8a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d90c74a445407ab6459be30826b3f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:35:53.380422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-8f18d842-febe-422f-97d3-8763e0f86bb0 req-8b90a363-f0b3-4d09-ade4-0f5abc1d9a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4c9802-6d78-4385-bea2-9fccff04955b", "name": "network-vif-deleted", "tag": "8a15c594-cba7-47ee-a2b3-43518a18cd89"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:35:53.381831 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:35:53.381831 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:35:53.388863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f532f60-2471-4594-ba20-3cea9f391f97 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 200 len: 1383 microversion: 2.1 time: 0.123976 Jan 26 19:35:53.389279 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-8f18d842-febe-422f-97d3-8763e0f86bb0 req-8b90a363-f0b3-4d09-ade4-0f5abc1d9a55 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:53.389808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 648/1313] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:53 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 1383 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:35:53.389956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-8f18d842-febe-422f-97d3-8763e0f86bb0 req-8b90a363-f0b3-4d09-ade4-0f5abc1d9a55 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:53.401625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-8f18d842-febe-422f-97d3-8763e0f86bb0 req-8b90a363-f0b3-4d09-ade4-0f5abc1d9a55 service nova] Creating event network-vif-deleted:8a15c594-cba7-47ee-a2b3-43518a18cd89 for instance 4d4c9802-6d78-4385-bea2-9fccff04955b on hv-cinder-79400 Jan 26 19:35:53.407598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-8f18d842-febe-422f-97d3-8763e0f86bb0 req-8b90a363-f0b3-4d09-ade4-0f5abc1d9a55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Jan 26 19:35:53.408374 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 666/1314] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:35:54.406203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:54.406809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] [instance: 4d4c9802-6d78-4385-bea2-9fccff04955b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:35:54.413636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:54.414078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:54.414850 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:35:54.415277 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:35:54.428368 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] HTTP exception thrown: Instance 4d4c9802-6d78-4385-bea2-9fccff04955b could not be found. Jan 26 19:35:54.428943 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Returning 404 to user: Instance 4d4c9802-6d78-4385-bea2-9fccff04955b could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:35:54.429776 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ca78f4e6-91b8-4440-b604-7cc786fadc62 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b" status: 404 len: 111 microversion: 2.1 time: 0.027205 Jan 26 19:35:54.430290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 649/1315] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:35:54 2022] GET /compute/v2.1/servers/4d4c9802-6d78-4385-bea2-9fccff04955b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:35:54.591721 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-be5188b7-b244-4296-a0bc-6e412fbb3350 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] Calling method '.version_select at 0x7fb7c0d60820>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:35:54.610137 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-be5188b7-b244-4296-a0bc-6e412fbb3350 tempest-TestShelveInstance-1505514135 tempest-TestShelveInstance-1505514135-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1418193573" status: 202 len: 0 microversion: 2.1 time: 0.022737 Jan 26 19:35:54.611446 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 667/1316] 10.222.0.50 () {58 vars in 1253 bytes} [Wed Jan 26 19:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1418193573 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:36:16.072075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:16.073044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:16.079478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.080448 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.081225 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.081663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.110056 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c938e095-9a53-4c25-91de-1c1e24979367 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041722 Jan 26 19:36:16.110608 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 650/1317] 10.222.0.50 () {60 vars in 1342 bytes} [Wed Jan 26 19:36:16 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:16.164934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:16.165570 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:16.173149 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.173600 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.174378 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.174821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.197961 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:36:16.278579 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ea059185-41b8-4c74-8e87-bae66e73932e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 204 len: 0 microversion: 2.20 time: 0.117554 Jan 26 19:36:16.279387 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 668/1318] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Jan 26 19:36:16 2022] DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 26 19:36:16.288148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:16.288754 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:16.295615 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.296126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.296908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:16.297338 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:16.481230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:16.488910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:16.490438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:16.491583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d7f73aac-26fb-4333-9711-9149ae092fa4 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.207644 Jan 26 19:36:16.492169 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 651/1319] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:16 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:36:17.510453 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:17.511056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:17.517226 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:17.517670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:17.518435 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:17.518868 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:17.650320 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:17.658589 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:17.660109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:17.661242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9ebff09d-89fa-4f75-8d59-274b3f6c660d tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.154939 Jan 26 19:36:17.661797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 669/1320] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:17 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:36:18.678455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:18.678987 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:18.685379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:18.685819 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:18.686612 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:18.687048 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:18.918133 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:18.926309 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:18.927847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38f0a0c41be44b4ab34f84df6f89b14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200619f76ac54211847de3c39fa7c681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:18.929081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7f4fd63b-9c7e-4f09-8fdc-05ba8549207f tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 200 len: 1722 microversion: 2.20 time: 0.254398 Jan 26 19:36:18.929764 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 652/1321] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:18 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 26 19:36:19.475541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-2901d10e-8643-46e5-afb7-7f521e1c3c0d req-253d4e1e-7cfa-4f91-834d-ab0228769d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499a8ea2-3fbf-498e-9f50-70aad706252a", "name": "network-vif-deleted", "tag": "0664d13c-ea6d-44a2-a092-3eeb2d932892"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:19.478630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:36:19.478630 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:36:19.490345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-2901d10e-8643-46e5-afb7-7f521e1c3c0d req-253d4e1e-7cfa-4f91-834d-ab0228769d36 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:19.490790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-2901d10e-8643-46e5-afb7-7f521e1c3c0d req-253d4e1e-7cfa-4f91-834d-ab0228769d36 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:19.505409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-2901d10e-8643-46e5-afb7-7f521e1c3c0d req-253d4e1e-7cfa-4f91-834d-ab0228769d36 service nova] Creating event network-vif-deleted:0664d13c-ea6d-44a2-a092-3eeb2d932892 for instance 499a8ea2-3fbf-498e-9f50-70aad706252a on hv-cinder-79400 Jan 26 19:36:19.510352 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-2901d10e-8643-46e5-afb7-7f521e1c3c0d req-253d4e1e-7cfa-4f91-834d-ab0228769d36 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Jan 26 19:36:19.510940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 670/1322] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:36:19.948471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:19.950046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:19.957522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:19.958117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:19.958900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:19.959379 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:19.978159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. Jan 26 19:36:19.978791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:36:19.979615 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d0e51beb-532e-4aa4-81b8-78e70f9a3162 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 404 len: 111 microversion: 2.20 time: 0.035880 Jan 26 19:36:19.980205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 653/1323] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:19 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:36:19.990055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-90fb1754-634d-4d62-bf2b-0496147cca0b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '.version_select at 0x7fb7c108d9d0>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:20.007965 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-90fb1754-634d-4d62-bf2b-0496147cca0b tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284416851" status: 204 len: 0 microversion: 2.20 time: 0.022859 Jan 26 19:36:20.008537 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 671/1324] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Jan 26 19:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284416851 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 26 19:36:26.011992 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:26.012520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:26.018426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:26.018863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:26.019630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:26.020082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:26.034735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. Jan 26 19:36:26.035301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:36:26.036120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fdbf1c10-64c1-4000-bc21-6380f8d078e7 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 404 len: 111 microversion: 2.20 time: 0.028016 Jan 26 19:36:26.036637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 654/1325] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Jan 26 19:36:26 2022] DELETE /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 26 19:36:26.044252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:26.044980 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: 499a8ea2-3fbf-498e-9f50-70aad706252a] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:26.051744 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:26.052230 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:26.052997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:26.053430 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:26.066615 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. Jan 26 19:36:26.067193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance 499a8ea2-3fbf-498e-9f50-70aad706252a could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:36:26.068020 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e91a9981-84fa-46de-bec8-41dd7b1dc5d2 tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a" status: 404 len: 111 microversion: 2.20 time: 0.027472 Jan 26 19:36:26.068541 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 672/1326] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:26 2022] GET /compute/v2.1/servers/499a8ea2-3fbf-498e-9f50-70aad706252a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:36:27.191628 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:27.192168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:27.198245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:27.198682 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:27.199442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:27.199892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:27.214221 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. Jan 26 19:36:27.214809 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:36:27.215611 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ba18f6a4-7c3b-4668-a6e6-fa5c272f1a2e tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 404 len: 111 microversion: 2.20 time: 0.028586 Jan 26 19:36:27.216158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 655/1327] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Jan 26 19:36:27 2022] DELETE /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:36:27.224481 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:27.225121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] [instance: a15ff6ad-b011-48d9-a8af-fc836715e6f5] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:27.231275 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:27.231703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:27.232519 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:27.232956 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:27.245811 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] HTTP exception thrown: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. Jan 26 19:36:27.246391 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] Returning 404 to user: Instance a15ff6ad-b011-48d9-a8af-fc836715e6f5 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:36:27.247197 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-02b04083-682d-4fbf-88e5-b04b3da4742a tempest-AttachVolumeShelveTestJSON-1776789270 tempest-AttachVolumeShelveTestJSON-1776789270-project] 10.222.0.50 "GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5" status: 404 len: 111 microversion: 2.20 time: 0.026985 Jan 26 19:36:27.247722 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 673/1328] 10.222.0.50 () {60 vars in 1276 bytes} [Wed Jan 26 19:36:27 2022] GET /compute/v2.1/servers/a15ff6ad-b011-48d9-a8af-fc836715e6f5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:36:32.594420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-963270686", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "3dfee021-f64b-48e0-8195-f604062d6f9b"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:32.645289 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] validate_networks() for [('3dfee021-f64b-48e0-8195-f604062d6f9b', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:36:33.032477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:36:33.032895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:36:33.033360 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:36:33.033765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:36:33.034716 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:36:33.043193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:33.043661 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:33.044501 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:33.044936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:33.063331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:36:33.067788 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for user 6337c5b93393443d8dee2ff6c7b0a121 and project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:36:33.078266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:36:33.080626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:36:33.123912 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [d9a2aa3c-9fb1-4869-9a01-7b9d565954a0] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 26 19:36:34.131352 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [d9a2aa3c-9fb1-4869-9a01-7b9d565954a0] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48838. Jan 26 19:36:34.135966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-06b87f89-8cb6-44ee-9409-1d73c4ddf655 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661932 Jan 26 19:36:34.136637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 656/1329] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 26 19:36:34.146859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-89dba1da-dfa4-42c5-b5ad-c73c2be0371d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:34.147846 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-89dba1da-dfa4-42c5-b5ad-c73c2be0371d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:34.201464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-89dba1da-dfa4-42c5-b5ad-c73c2be0371d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:34.208338 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-89dba1da-dfa4-42c5-b5ad-c73c2be0371d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1217 microversion: 2.1 time: 0.065712 Jan 26 19:36:34.209206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 674/1330] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:34 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:35.227073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:35.227937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:35.235862 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:35.236450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:35.237335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:35.237879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:35.310566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:35.331119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f080262d-b7c2-46b4-bf2b-79269e256b90 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1287 microversion: 2.1 time: 0.109705 Jan 26 19:36:35.331705 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 657/1331] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:35 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:36.347471 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:36.348421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:36.356698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:36.359277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:36.360042 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:36.360562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:36.466370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f4a18400-599e-4be3-99a3-bac8225005d6 req-9ed97b9d-3a1e-4917-a453-d8c744055cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626669d2-1559-4ee3-a821-5700455c065b", "tag": "d7374057-ff0b-46c0-97e2-544a3f54a28d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:36.469592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:36:36.469592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:36:36.478131 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f4a18400-599e-4be3-99a3-bac8225005d6 req-9ed97b9d-3a1e-4917-a453-d8c744055cc3 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:36.478647 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f4a18400-599e-4be3-99a3-bac8225005d6 req-9ed97b9d-3a1e-4917-a453-d8c744055cc3 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:36.490529 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f4a18400-599e-4be3-99a3-bac8225005d6 req-9ed97b9d-3a1e-4917-a453-d8c744055cc3 service nova] Creating event network-changed:d7374057-ff0b-46c0-97e2-544a3f54a28d for instance 626669d2-1559-4ee3-a821-5700455c065b on hv-cinder-79400 Jan 26 19:36:36.496003 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f4a18400-599e-4be3-99a3-bac8225005d6 req-9ed97b9d-3a1e-4917-a453-d8c744055cc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033772 Jan 26 19:36:36.496902 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 658/1332] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:36:36.520444 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:36.528350 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-8595dd81-6aa6-41ee-844b-a98035c9d861 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.184745 Jan 26 19:36:36.528952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 675/1333] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:36 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:37.546465 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:37.547145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:37.553365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:37.553805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:37.554568 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:37.554999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:37.681478 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:37.689401 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c46a9b4f-4a44-4e13-a548-12bd2b6590ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.147333 Jan 26 19:36:37.690540 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 659/1334] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:37 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:38.707920 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:38.708660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:38.715598 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:38.716070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:38.716859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:38.717290 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:38.842448 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:38.850217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5b3300b7-e7e6-434e-9c90-a95ce834fc22 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.147357 Jan 26 19:36:38.850775 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 676/1335] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:38 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:39.866799 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:39.867403 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:39.873676 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:39.874126 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:39.874898 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:39.875331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:40.007701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:40.014908 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-340f1ac6-4918-4550-9d47-7dad39e07cda tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.151813 Jan 26 19:36:40.015469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 660/1336] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:39 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:41.033032 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:41.033666 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:41.040046 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:41.040496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:41.041265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:41.041696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:41.175512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:41.182828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-357e1c5f-14a9-4d36-985f-e8779fe551b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.153846 Jan 26 19:36:41.183521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 677/1337] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:41 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:36:42.198592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:42.199203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:42.206211 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:42.206664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:42.207427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:42.207879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:42.330427 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:42.337670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-18b9d236-5d85-4b80-b3ab-ce83e2666cfe tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.142764 Jan 26 19:36:42.338233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 661/1338] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:42 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:43.354163 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:43.354801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:43.361066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:43.361516 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:43.362294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:43.362731 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:43.486173 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:43.493452 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f98eb3b5-cac7-4e31-9fdd-49be576cfb98 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.143090 Jan 26 19:36:43.494021 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 678/1339] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:43 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:44.509787 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:44.510388 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:44.516714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:44.517166 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:44.517936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:44.518857 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:44.646918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:44.654278 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1aeebb1c-b37f-45e2-8802-21cadcc276ec tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.148167 Jan 26 19:36:44.654838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 662/1340] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:44 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:45.671375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:45.671939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:45.678730 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:45.679177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:45.679977 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:45.680404 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:45.808932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:45.816332 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-de18ce37-e35e-413d-bc4c-a59c1b64cd5a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.148733 Jan 26 19:36:45.816889 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 679/1341] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:45 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:36:46.833473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:46.834072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:46.840405 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:46.840846 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:46.841625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:46.842044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:46.964931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:46.973015 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b9dc382d-c907-4609-a0bc-8c17e3b1bb0c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.143255 Jan 26 19:36:46.973273 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 663/1342] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:46 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:47.990056 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:47.990700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:47.997017 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:47.997463 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:47.998242 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:47.998677 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:48.128932 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:48.136670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-73e42583-6da7-462b-a453-cf5774c881b9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.151377 Jan 26 19:36:48.137372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 680/1343] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:47 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:48.952982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-9795ac86-a52d-431a-a968-eac4ece8b266 req-84d08aea-84e1-4ba0-aade-5ee762135ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626669d2-1559-4ee3-a821-5700455c065b", "name": "network-vif-plugged", "status": "completed", "tag": "d7374057-ff0b-46c0-97e2-544a3f54a28d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:48.954588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:36:48.954588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:36:48.961903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9795ac86-a52d-431a-a968-eac4ece8b266 req-84d08aea-84e1-4ba0-aade-5ee762135ceb service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:48.962351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9795ac86-a52d-431a-a968-eac4ece8b266 req-84d08aea-84e1-4ba0-aade-5ee762135ceb service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:48.973402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-9795ac86-a52d-431a-a968-eac4ece8b266 req-84d08aea-84e1-4ba0-aade-5ee762135ceb service nova] Creating event network-vif-plugged:d7374057-ff0b-46c0-97e2-544a3f54a28d for instance 626669d2-1559-4ee3-a821-5700455c065b on hv-cinder-79400 Jan 26 19:36:48.978186 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-9795ac86-a52d-431a-a968-eac4ece8b266 req-84d08aea-84e1-4ba0-aade-5ee762135ceb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083228 Jan 26 19:36:48.978765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 664/1344] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:36:49.153329 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:49.153936 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:49.160247 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:49.160695 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:49.161469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:49.161902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:49.286638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:49.293750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a31b7806-180f-4403-ae3d-98039944f7ee tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.144101 Jan 26 19:36:49.294302 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 681/1345] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:49 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:50.311731 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:50.312376 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:50.318494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:50.318937 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:50.319708 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:50.320163 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:50.447442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:50.454996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-942cc7ed-e767-45a6-86dd-cc647fc1e21b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1317 microversion: 2.1 time: 0.147799 Jan 26 19:36:50.455566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 665/1346] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:50 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:51.471456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:51.472228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:51.479341 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:51.479928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:51.480750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:51.481353 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:51.618162 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:51.625411 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-539c6001-bef7-4228-b847-0ace5b11d6cf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1507 microversion: 2.1 time: 0.157856 Jan 26 19:36:51.625974 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 682/1347] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:51 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:52.256247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1775285887", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1429712429", "security_groups": [{"name": "tempest-secgroup-smoke-634496094"}], "block_device_mapping_v2": [{"uuid": "17e818e1-555e-470c-b664-505441ee75f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "271d7cd6-39be-4683-b50e-e90ed3ff8279"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:52.360500 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] validate_networks() for [('271d7cd6-39be-4683-b50e-e90ed3ff8279', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:36:52.704979 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:36:52.705471 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:36:52.706486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:36:52.706920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:36:52.707327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:36:52.715884 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:52.716279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:52.717089 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:52.717521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:52.733931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:36:52.737863 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Getting quotas for user 477b689bf5c0415aa7eba64b81d8602a and project 8c4fb0a5c0e74ac8bfc5dd910bac07f5. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:36:52.791220 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:36:52.793365 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17e818e1-555e-470c-b664-505441ee75f1',volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:36:52.908798 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6272e152-f379-4a28-ab67-994c261bc12a tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.656451 Jan 26 19:36:52.909590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 666/1348] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:36:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:36:52.918968 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c42d44d6-4b32-4c1a-8384-2a76add270af tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:52.919611 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c42d44d6-4b32-4c1a-8384-2a76add270af tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:52.973643 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c42d44d6-4b32-4c1a-8384-2a76add270af tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:52.980786 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c42d44d6-4b32-4c1a-8384-2a76add270af tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1095 microversion: 2.1 time: 0.065389 Jan 26 19:36:52.981366 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 683/1349] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:52 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:53.997662 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:53.998245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:54.006044 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:54.006495 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:54.007282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:54.007711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:54.017252 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73818db2-4745-400d-b59f-991e278e8b31"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:54.019081 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:54.027459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:54.028747 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:54.029636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:54.030158 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:54.076721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:54.084582 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6ea7bb08-4ced-4065-a934-3ca3c019227d tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1211 microversion: 2.1 time: 0.090455 Jan 26 19:36:54.085714 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 667/1350] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:53 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:54.303058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-fdb2ed5b-3571-4172-9360-d476470b1281 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291201 Jan 26 19:36:54.303719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 684/1351] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:36:54 2022] POST /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:36:55.101895 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:55.102613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:55.108888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:55.109280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:55.110055 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:55.110488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:55.344193 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:55.352361 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7c610176-c0ac-4b9a-a4fd-f03d76a3b953 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.254036 Jan 26 19:36:55.356335 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 668/1352] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:55 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:55.432940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-fd4c719e-b5b9-41cf-8030-7752f5b4b7ae req-30df19f9-300b-40e5-a2d2-d4ec7626d3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0131be9-22c7-43ff-83aa-ee8fef26df82", "tag": "2fd42577-2df6-46e5-b3c1-d7513432947d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:36:55.434698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:36:55.434698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:36:55.444761 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-fd4c719e-b5b9-41cf-8030-7752f5b4b7ae req-30df19f9-300b-40e5-a2d2-d4ec7626d3a7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:55.445288 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-fd4c719e-b5b9-41cf-8030-7752f5b4b7ae req-30df19f9-300b-40e5-a2d2-d4ec7626d3a7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:55.464773 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-fd4c719e-b5b9-41cf-8030-7752f5b4b7ae req-30df19f9-300b-40e5-a2d2-d4ec7626d3a7 service nova] Creating event network-changed:2fd42577-2df6-46e5-b3c1-d7513432947d for instance f0131be9-22c7-43ff-83aa-ee8fef26df82 on hv-cinder-79400 Jan 26 19:36:55.469988 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-fd4c719e-b5b9-41cf-8030-7752f5b4b7ae req-30df19f9-300b-40e5-a2d2-d4ec7626d3a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042771 Jan 26 19:36:55.471135 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 685/1353] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:36:56.369145 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:56.369864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:56.376045 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:56.376488 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:56.377256 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:56.377684 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:56.509519 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:56.516670 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-727f1143-f1c7-4207-a6eb-212126fb7a9e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.151303 Jan 26 19:36:56.517233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 669/1354] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:56 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:57.534542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:57.535232 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:57.541193 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:57.541702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:57.542405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:57.542838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:57.670726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:57.678478 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d087c42c-bdec-43d1-88eb-e297d7a39c85 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.148399 Jan 26 19:36:57.679039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 686/1355] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:57 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:58.694446 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:58.695130 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:58.701280 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:58.701724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:58.702490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:58.702916 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:58.850892 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:36:58.858265 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2c4ece7a-c29f-4b63-a1f8-90ef9a3f5f49 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.167575 Jan 26 19:36:58.858839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 670/1356] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:58 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:36:59.875434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:36:59.876140 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:36:59.882768 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:59.883211 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:36:59.884008 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:36:59.884441 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:00.026024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:00.033774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ac158b18-183d-42ae-93a5-af4e19764c35 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.162010 Jan 26 19:37:00.034858 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 687/1357] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:36:59 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:01.050375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:01.050973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:01.057136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:01.057592 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:01.058343 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:01.058769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:01.182575 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:01.189646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-64a029bb-8a31-4682-aeeb-a8849d79f8e1 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.143324 Jan 26 19:37:01.190203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 671/1358] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:01 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:02.206883 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:02.207485 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:02.213694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:02.214141 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:02.214908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:02.215340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:02.346133 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:02.354755 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-19bba4ab-5806-4f96-ad9c-eeba5b7eae10 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.152052 Jan 26 19:37:02.355339 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 688/1359] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:02 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:03.371347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:03.371971 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:03.378864 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:03.379302 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:03.380102 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:03.380532 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:03.509236 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:03.516640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b5eaf40b-bb09-4da6-b6f9-64e184ef19ac tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.149012 Jan 26 19:37:03.517411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 672/1360] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:03 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:04.533292 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:04.533927 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:04.540093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:04.540538 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:04.541293 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:04.541720 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:04.669469 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:04.676636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-57e393f3-8c86-4ecb-b00a-b3af9cdfcfd3 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.147050 Jan 26 19:37:04.677192 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 689/1361] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:04 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:05.693560 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:05.694148 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:05.700480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:05.700955 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:05.701726 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:05.702161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:05.828264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:05.836056 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6a8f9101-dabd-4ff5-a9e6-9c3cdcb5f6bf tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.146746 Jan 26 19:37:05.836630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 673/1362] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:05 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:06.852588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:06.853200 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:06.859422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:06.859908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:06.860684 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:06.861118 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:06.989997 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:06.997145 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-85c6113b-7fae-4c03-a561-b9c5c3a1e4a2 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.148221 Jan 26 19:37:06.997703 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 690/1363] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:06 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:08.013288 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:08.013891 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:08.020075 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:08.020522 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:08.021319 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:08.021751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:08.151222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:08.158451 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5d9e954-2051-4306-91a0-ee283565ce4e tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.148777 Jan 26 19:37:08.159326 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 674/1364] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:08 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:09.175176 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:09.175794 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:09.182084 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:09.182532 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:09.183314 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:09.183750 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:09.310823 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:09.318839 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c08fafc1-acfd-4ed6-91b4-307074759e08 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.147274 Jan 26 19:37:09.319412 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 691/1365] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:09 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:10.335477 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:10.336113 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:10.342370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:10.342810 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:10.343588 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:10.344046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:10.470900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:10.478661 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5465d79d-22f2-4077-9431-bf1781accab8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.146819 Jan 26 19:37:10.479233 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 675/1366] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:10 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:11.495436 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:11.495986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:11.502726 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:11.503172 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:11.503975 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:11.504406 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:11.639442 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:11.646546 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-79dbb32f-f4f2-43d9-ba58-03b8e79618bc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.154838 Jan 26 19:37:11.647104 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 692/1367] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:11 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:12.663505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:12.664158 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:12.670457 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:12.670901 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:12.671675 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:12.672132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:12.800437 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:12.808315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-54c76011-ba14-4eb5-93ab-1407b4427355 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.148997 Jan 26 19:37:12.808878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 676/1368] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:12 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:13.824509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:13.825121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:13.831399 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:13.831881 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:13.832659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:13.833599 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:13.958790 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:13.965941 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-069ab63f-2a92-47e9-8967-a612a04af6d9 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.145074 Jan 26 19:37:13.966501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 693/1369] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:13 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:14.982153 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:14.982738 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:14.988969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:14.989411 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:14.990175 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:14.990603 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:15.118814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:15.125954 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c7f655b5-ad25-4dba-8fca-f31a66ef6c97 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.147474 Jan 26 19:37:15.126518 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 677/1370] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:14 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:16.142121 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:16.142748 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:16.150126 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:16.150569 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:16.151389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:16.151846 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:16.287810 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:16.294988 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-cfaa5c09-b458-445c-ae99-664bb3608407 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.156508 Jan 26 19:37:16.295552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 694/1371] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:16 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:16.490785 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-758747824", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "3dfee021-f64b-48e0-8195-f604062d6f9b"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:16.548640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] validate_networks() for [('3dfee021-f64b-48e0-8195-f604062d6f9b', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:37:17.074691 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:37:17.075112 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:37:17.075580 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:37:17.076028 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:37:17.076438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:37:17.085543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:17.085993 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:17.086812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:17.087247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:17.104883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:37:17.109059 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for user 6337c5b93393443d8dee2ff6c7b0a121 and project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:37:17.121312 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:37:17.123534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:37:17.171205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2b8cb171-7d8f-49b1-9c3c-feda3a4ac9f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683679 Jan 26 19:37:17.172744 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 678/1372] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:37:17.183277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-d60ef825-f671-4d0f-8feb-30e87bab922e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:17.190301 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-d60ef825-f671-4d0f-8feb-30e87bab922e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:17.249184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-d60ef825-f671-4d0f-8feb-30e87bab922e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:17.256100 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-d60ef825-f671-4d0f-8feb-30e87bab922e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1217 microversion: 2.1 time: 0.076361 Jan 26 19:37:17.256738 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 695/1373] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:17 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:17.311443 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:17.312072 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:17.318035 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:17.318514 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:17.319287 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:17.319721 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:17.459914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:17.467511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-82a6333d-4da1-42ce-93a1-85a4ce0cec54 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.159913 Jan 26 19:37:17.468247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 679/1374] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:17 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:18.272022 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:18.272659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:18.280007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:18.280467 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:18.281248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:18.281719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:18.343365 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:18.350986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-20da43f3-d57a-44aa-818e-b67b4a6b26b6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1275 microversion: 2.1 time: 0.083000 Jan 26 19:37:18.351555 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 696/1375] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:18 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:18.484874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:18.485470 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:18.492161 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:18.492602 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:18.493374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:18.493803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:18.675367 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:18.683119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3e972772-0db3-4d96-95c5-f7c7a89cda75 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.201808 Jan 26 19:37:18.683698 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 680/1376] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:18 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:19.091951 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-0e2649cf-0449-458f-8a32-32089e0f84ee req-dc1724c4-bd89-4013-aa20-315e2f5fe24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0131be9-22c7-43ff-83aa-ee8fef26df82", "name": "network-vif-plugged", "status": "completed", "tag": "2fd42577-2df6-46e5-b3c1-d7513432947d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:19.093590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:19.093590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:19.104148 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-0e2649cf-0449-458f-8a32-32089e0f84ee req-dc1724c4-bd89-4013-aa20-315e2f5fe24d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.104594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-0e2649cf-0449-458f-8a32-32089e0f84ee req-dc1724c4-bd89-4013-aa20-315e2f5fe24d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.116204 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-0e2649cf-0449-458f-8a32-32089e0f84ee req-dc1724c4-bd89-4013-aa20-315e2f5fe24d service nova] Creating event network-vif-plugged:2fd42577-2df6-46e5-b3c1-d7513432947d for instance f0131be9-22c7-43ff-83aa-ee8fef26df82 on hv-cinder-79400 Jan 26 19:37:19.121542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-0e2649cf-0449-458f-8a32-32089e0f84ee req-dc1724c4-bd89-4013-aa20-315e2f5fe24d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Jan 26 19:37:19.122831 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 697/1377] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:19.368964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:19.369980 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:19.376893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.377498 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.378352 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.379084 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.700581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:19.701315 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:19.707814 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.708330 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.709157 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.710005 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.745928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:19.759683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-81727ea1-9971-417a-a9e9-2d59b2c6670c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.395424 Jan 26 19:37:19.760418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 681/1378] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:19 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:19.842739 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-5a94849e-c9f6-48f2-9e50-15e1548eae8c req-f1436bcf-5fc0-49dd-b949-d7aa55615c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6a62b3-b85b-4d4a-8559-aa29f3668072", "tag": "2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:19.845106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:19.845106 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:37:19.853505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a94849e-c9f6-48f2-9e50-15e1548eae8c req-f1436bcf-5fc0-49dd-b949-d7aa55615c0d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:19.854363 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a94849e-c9f6-48f2-9e50-15e1548eae8c req-f1436bcf-5fc0-49dd-b949-d7aa55615c0d service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:19.854641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:19.864181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6d0454d7-c595-4dd3-97de-b5d496ede0f5 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.168000 Jan 26 19:37:19.864822 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 698/1379] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:19 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:19.879826 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-5a94849e-c9f6-48f2-9e50-15e1548eae8c req-f1436bcf-5fc0-49dd-b949-d7aa55615c0d service nova] Creating event network-changed:2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1 for instance 8d6a62b3-b85b-4d4a-8559-aa29f3668072 on hv-cinder-79400 Jan 26 19:37:19.885262 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-5a94849e-c9f6-48f2-9e50-15e1548eae8c req-f1436bcf-5fc0-49dd-b949-d7aa55615c0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Jan 26 19:37:19.885867 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 682/1380] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:37:20.776966 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:20.778184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:20.784974 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:20.785677 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:20.786625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:20.787061 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:20.882178 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:20.882878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:20.889206 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:20.889849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:20.890657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:20.891092 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:20.986826 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:21.002571 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4a250fcc-20dc-4d11-aba8-a4e143d0ca09 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.229854 Jan 26 19:37:21.015922 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 699/1381] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:20 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:21.040657 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:21.049016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6b02b16b-40b5-44a9-805c-42be70c50dd6 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1266 microversion: 2.1 time: 0.171349 Jan 26 19:37:21.049590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 683/1382] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:20 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:22.018331 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:22.018936 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:22.025219 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.025662 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.026443 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.026877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.066201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:22.067431 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:22.074125 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.074793 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.075590 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.076040 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.180073 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:22.189205 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-1584cb28-207a-430e-b65b-d32565b10a77 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.174317 Jan 26 19:37:22.190698 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 700/1383] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:22 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:22.227204 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:22.235294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-29151c77-2382-44b0-9561-c5b7de17552f tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1453 microversion: 2.1 time: 0.173032 Jan 26 19:37:22.235899 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 684/1384] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:22 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:22.251458 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:22.252094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:22.258619 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.259063 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.259853 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:22.260281 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:22.391327 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:22.400639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-eca26e22-9122-4efd-948b-42a0a1d923df tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1453 microversion: 2.1 time: 0.152765 Jan 26 19:37:22.401210 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 701/1385] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:22 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:23.206068 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:23.207345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:23.213964 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:23.214655 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:23.215614 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:23.216231 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:23.357585 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:23.365438 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6b5d26a0-18c8-4149-a924-a601f219e61e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.162903 Jan 26 19:37:23.366010 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 685/1386] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:23 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:24.132821 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-3707da42-a168-4066-9466-816e24c726e5 req-988d1af3-e374-4876-b45f-02124c39fb4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0131be9-22c7-43ff-83aa-ee8fef26df82", "tag": "2fd42577-2df6-46e5-b3c1-d7513432947d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:24.134388 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:24.134388 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:24.142244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-3707da42-a168-4066-9466-816e24c726e5 req-988d1af3-e374-4876-b45f-02124c39fb4f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:24.142736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-3707da42-a168-4066-9466-816e24c726e5 req-988d1af3-e374-4876-b45f-02124c39fb4f service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:24.155543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-3707da42-a168-4066-9466-816e24c726e5 req-988d1af3-e374-4876-b45f-02124c39fb4f service nova] Creating event network-changed:2fd42577-2df6-46e5-b3c1-d7513432947d for instance f0131be9-22c7-43ff-83aa-ee8fef26df82 on hv-cinder-79400 Jan 26 19:37:24.160588 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-3707da42-a168-4066-9466-816e24c726e5 req-988d1af3-e374-4876-b45f-02124c39fb4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031308 Jan 26 19:37:24.161184 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 702/1387] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:24.382247 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:24.383138 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:24.389679 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:24.390180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:24.391181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:24.391618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:24.599331 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:24.608181 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6f846635-601e-4193-810e-19d195225d8b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.229867 Jan 26 19:37:24.609366 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 686/1388] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:24 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:25.625563 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:25.626318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:25.632294 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:25.632734 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:25.633496 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:25.633924 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:25.761157 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:25.768517 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-97447662-72e8-4cb2-b88d-82d8e66f697c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.147455 Jan 26 19:37:25.769086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 703/1389] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:25 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:26.785784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:26.786416 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:26.793203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:26.793649 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:26.794447 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:26.794878 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:26.934006 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:26.941636 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a72ff7f9-d3d8-4674-90b8-4f2eb4efad68 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.159551 Jan 26 19:37:26.942328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 687/1390] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:26 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:27.089663 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-c98b2887-bbbd-4346-b41f-fdb0a9ec1102 req-7c6d5d73-2ad2-40ee-8d52-d5d6794227d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6a62b3-b85b-4d4a-8559-aa29f3668072", "name": "network-vif-plugged", "status": "completed", "tag": "2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:27.091190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:27.091190 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:27.098094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c98b2887-bbbd-4346-b41f-fdb0a9ec1102 req-7c6d5d73-2ad2-40ee-8d52-d5d6794227d7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:27.098731 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-c98b2887-bbbd-4346-b41f-fdb0a9ec1102 req-7c6d5d73-2ad2-40ee-8d52-d5d6794227d7 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:27.110177 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-c98b2887-bbbd-4346-b41f-fdb0a9ec1102 req-7c6d5d73-2ad2-40ee-8d52-d5d6794227d7 service nova] Creating event network-vif-plugged:2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1 for instance 8d6a62b3-b85b-4d4a-8559-aa29f3668072 on hv-cinder-79400 Jan 26 19:37:27.114994 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-c98b2887-bbbd-4346-b41f-fdb0a9ec1102 req-7c6d5d73-2ad2-40ee-8d52-d5d6794227d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028957 Jan 26 19:37:27.115820 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 704/1391] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:27.958016 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:27.958616 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:27.964765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:27.965301 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:27.966140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:27.966643 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:28.099077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:28.106226 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8da2e950-b3fd-447b-9035-0faf9dcddc39 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1317 microversion: 2.1 time: 0.151839 Jan 26 19:37:28.106808 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 688/1392] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:27 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:29.123152 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:29.123863 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:29.129797 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.130241 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.131007 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.131433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.260567 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:29.267840 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4647f5a6-8d7b-4a64-94ef-f747bf6e02e7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1508 microversion: 2.1 time: 0.149219 Jan 26 19:37:29.268547 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 705/1393] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:29 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:29.284604 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73818db2-4745-400d-b59f-991e278e8b31"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:29.285638 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:29.291814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.292205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.292969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.293399 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.370081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Invalid volume: volume 73818db2-4745-400d-b59f-991e278e8b31 is already attached to instances: 626669d2-1559-4ee3-a821-5700455c065b Jan 26 19:37:29.370677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 400 to user: Invalid volume: volume 73818db2-4745-400d-b59f-991e278e8b31 is already attached to instances: 626669d2-1559-4ee3-a821-5700455c065b {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:37:29.371513 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0665070f-8afa-48df-a0cf-4c83fb566537 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090707 Jan 26 19:37:29.372090 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 689/1394] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:37:29 2022] POST /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:37:29.428239 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:29.428733 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:29.435234 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.435675 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.436490 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.436918 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.512639 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lazy-loading 'services' on Instance uuid 626669d2-1559-4ee3-a821-5700455c065b {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:37:29.578244 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5de52259-3f09-43ee-8dde-f784e0ce0d4d tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments/73818db2-4745-400d-b59f-991e278e8b31" status: 202 len: 0 microversion: 2.1 time: 0.153635 Jan 26 19:37:29.578862 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 706/1395] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:37:29 2022] DELETE /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments/73818db2-4745-400d-b59f-991e278e8b31 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:37:29.586827 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:29.587910 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:29.594893 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.595529 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.596327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:29.596838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:29.626282 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a558f3c-6c05-47c9-95b0-1f3f162ad313 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Jan 26 19:37:29.626842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 690/1396] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:37:29 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:30.639328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:30.640395 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:30.646489 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:30.646939 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:30.647742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:30.649014 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:30.676251 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e8019c4e-c547-49cb-818a-cc6b5ae25631 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041471 Jan 26 19:37:30.676793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 707/1397] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:37:30 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:37:30.822769 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1895935601", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "3dfee021-f64b-48e0-8195-f604062d6f9b"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:30.871110 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] validate_networks() for [('3dfee021-f64b-48e0-8195-f604062d6f9b', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:37:31.211712 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:37:31.212242 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:37:31.212833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:37:31.213294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:37:31.213751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:37:31.222174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:31.222637 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:31.223418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:31.223874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:31.239395 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:37:31.243732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for user 6337c5b93393443d8dee2ff6c7b0a121 and project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:37:31.254081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:37:31.256357 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:37:31.302117 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fd0be5e3-27b5-463e-a2bc-c45ce1f4f70e tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483409 Jan 26 19:37:31.302903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 691/1398] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:37:31.312958 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-34a7fd7f-d415-446b-9772-19b47a401b7b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:31.313694 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-34a7fd7f-d415-446b-9772-19b47a401b7b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:31.369702 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-34a7fd7f-d415-446b-9772-19b47a401b7b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:31.376095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-34a7fd7f-d415-446b-9772-19b47a401b7b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1218 microversion: 2.1 time: 0.066824 Jan 26 19:37:31.376653 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 708/1399] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:31 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:32.391947 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:32.392687 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:32.400613 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:32.401136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:32.401981 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:32.402509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:32.472351 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:32.479559 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9f590cd8-eee4-45d5-9ed9-cd4645bf16e9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1276 microversion: 2.1 time: 0.091145 Jan 26 19:37:32.480136 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 692/1400] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:32 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:33.484629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-e199f530-8063-4f8e-ad1e-c6add7867e3a req-5e5a1316-cfde-4e8c-854e-39a718ab6d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eecef0f-f964-4d98-a685-678c4c35fc64", "tag": "d91d131a-61eb-43aa-89a3-031afce1b712"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:33.486380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:33.486380 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:33.495214 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-e199f530-8063-4f8e-ad1e-c6add7867e3a req-5e5a1316-cfde-4e8c-854e-39a718ab6d96 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:33.495656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-e199f530-8063-4f8e-ad1e-c6add7867e3a req-5e5a1316-cfde-4e8c-854e-39a718ab6d96 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:33.497037 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:33.498458 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:33.506437 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-e199f530-8063-4f8e-ad1e-c6add7867e3a req-5e5a1316-cfde-4e8c-854e-39a718ab6d96 service nova] Creating event network-changed:d91d131a-61eb-43aa-89a3-031afce1b712 for instance 4eecef0f-f964-4d98-a685-678c4c35fc64 on hv-cinder-79400 Jan 26 19:37:33.511625 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-e199f530-8063-4f8e-ad1e-c6add7867e3a req-5e5a1316-cfde-4e8c-854e-39a718ab6d96 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031030 Jan 26 19:37:33.512389 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:33.512793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 709/1401] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:37:33.513270 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:33.514919 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:33.515362 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:33.938266 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:33.946036 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20d8f0ed-8f28-4230-aa9f-49d6aa1f6445 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.453408 Jan 26 19:37:33.946607 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 693/1402] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:33 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:37:34.963715 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:34.964364 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:34.970506 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:34.970953 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:34.971719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:34.972176 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:35.100976 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:35.108086 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c7a728ca-4b7c-485f-ab6d-b0e29f167ea8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.149376 Jan 26 19:37:35.108658 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 710/1403] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:34 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:36.124213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:36.124812 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:36.131081 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:36.131521 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:36.132308 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:36.132736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:36.260791 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:36.267829 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-80a64190-de71-49a9-9315-3da7daf60cc1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.147236 Jan 26 19:37:36.268387 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 694/1404] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:36 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:37.283919 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:37.284524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:37.291264 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:37.291706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:37.292509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:37.292940 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:37.418066 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:37.425284 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-2c09b9b8-856a-4296-ac66-6afd7c733b80 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.145099 Jan 26 19:37:37.425841 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 711/1405] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:37 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:38.442186 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:38.442713 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:38.449556 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:38.449999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:38.450774 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:38.451205 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:38.576469 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:38.585463 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-83c83563-b3fc-40f9-bdb0-b4436a9b5411 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.146669 Jan 26 19:37:38.586406 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 695/1406] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:38 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:39.161203 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-cc422dc2-fe3e-4665-88a7-db38a99858e7 req-40fb9b80-374a-4a30-887d-c78d08733efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eecef0f-f964-4d98-a685-678c4c35fc64", "name": "network-vif-plugged", "status": "completed", "tag": "d91d131a-61eb-43aa-89a3-031afce1b712"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:39.162857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:39.162857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:39.172074 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-cc422dc2-fe3e-4665-88a7-db38a99858e7 req-40fb9b80-374a-4a30-887d-c78d08733efc service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:39.172509 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-cc422dc2-fe3e-4665-88a7-db38a99858e7 req-40fb9b80-374a-4a30-887d-c78d08733efc service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:39.183421 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-cc422dc2-fe3e-4665-88a7-db38a99858e7 req-40fb9b80-374a-4a30-887d-c78d08733efc service nova] Creating event network-vif-plugged:d91d131a-61eb-43aa-89a3-031afce1b712 for instance 4eecef0f-f964-4d98-a685-678c4c35fc64 on hv-cinder-79400 Jan 26 19:37:39.188416 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-cc422dc2-fe3e-4665-88a7-db38a99858e7 req-40fb9b80-374a-4a30-887d-c78d08733efc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Jan 26 19:37:39.188999 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 712/1407] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:39.602281 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:39.602879 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:39.609345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:39.609737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:39.610505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:39.610933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:39.737839 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:39.744935 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31fb575f-ff4a-44ab-ac0b-371648fd4da1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.146320 Jan 26 19:37:39.745493 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 696/1408] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:39 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:40.761934 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:40.762621 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:40.769024 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:40.769464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:40.770254 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:40.770680 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:40.895422 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:40.903464 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-24c5df57-794e-4193-9741-e4dbaedf2ed2 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1318 microversion: 2.1 time: 0.145549 Jan 26 19:37:40.904058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 713/1409] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:40 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:41.920174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:41.920761 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:41.926967 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:41.927408 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:41.928199 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:41.928625 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:42.051900 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:42.059646 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-edaa66c7-80d3-41c6-a7a8-263dcda74ebf tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1509 microversion: 2.1 time: 0.143080 Jan 26 19:37:42.060250 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 697/1410] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:41 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:43.364618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02038664-06ba-4e40-9f98-886f32a19c51"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:43.365656 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:43.372462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:43.372902 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:43.373672 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:43.374097 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:43.595944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-db2d571e-028f-41cf-b332-13f3ce3238c6 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235036 Jan 26 19:37:43.596543 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 714/1411] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:37:43 2022] POST /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:51.042345 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02038664-06ba-4e40-9f98-886f32a19c51"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:51.043486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:51.049701 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.050149 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.050922 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.051358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.127168 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Invalid volume: volume 02038664-06ba-4e40-9f98-886f32a19c51 is already attached to instances: 4eecef0f-f964-4d98-a685-678c4c35fc64 Jan 26 19:37:51.127763 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 400 to user: Invalid volume: volume 02038664-06ba-4e40-9f98-886f32a19c51 is already attached to instances: 4eecef0f-f964-4d98-a685-678c4c35fc64 {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:37:51.128640 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aafad95b-c3fb-4d40-a84d-f93fb92577b7 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090581 Jan 26 19:37:51.129173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 698/1412] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:37:51 2022] POST /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 26 19:37:51.187055 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:51.187640 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:51.194001 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.194439 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.195218 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.195643 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.269747 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lazy-loading 'services' on Instance uuid 4eecef0f-f964-4d98-a685-678c4c35fc64 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:37:51.335552 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-39c006cf-1e8b-4d1b-910b-b122ac107ffc tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments/02038664-06ba-4e40-9f98-886f32a19c51" status: 202 len: 0 microversion: 2.1 time: 0.153044 Jan 26 19:37:51.336696 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 715/1413] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:37:51 2022] DELETE /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments/02038664-06ba-4e40-9f98-886f32a19c51 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:37:51.344626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:51.345583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:51.351505 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.352493 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.353232 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:51.353664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:51.382906 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd3eb0b4-ff4c-4de8-91ad-8f500a46c258 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041968 Jan 26 19:37:51.383587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 699/1414] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:37:51 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:52.395160 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:52.396231 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:52.402580 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:52.403028 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:52.403829 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:52.404265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:52.432638 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4a4143d7-0906-4f7a-944e-20dd468885b1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042033 Jan 26 19:37:52.433117 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 716/1415] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:37:52 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:37:52.594547 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1577728148", "imageRef": "d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6", "flavorRef": "452", "networks": [{"uuid": "3dfee021-f64b-48e0-8195-f604062d6f9b"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:52.640535 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] validate_networks() for [('3dfee021-f64b-48e0-8195-f604062d6f9b', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 26 19:37:52.986046 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 26 19:37:52.986459 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 26 19:37:52.986920 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 26 19:37:52.987317 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 26 19:37:52.987717 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 26 19:37:52.996111 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:52.996494 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:52.997306 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:52.997719 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:53.014508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 26 19:37:53.018135 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Getting quotas for user 6337c5b93393443d8dee2ff6c7b0a121 and project 45b7093fc6044e2dbc5ec6163648ea14. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 26 19:37:53.029207 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 26 19:37:53.031264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d82b1606-8b4a-4ea2-9d52-a8e4b29a25a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 26 19:37:53.076001 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72807ce2-706d-4ad5-8d27-1147a72bc6eb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485220 Jan 26 19:37:53.076847 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 700/1416] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Jan 26 19:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 26 19:37:53.087097 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-aa3ab666-c39e-4a11-ba44-5adbcf2c9018 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:53.088383 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-aa3ab666-c39e-4a11-ba44-5adbcf2c9018 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:53.142101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-aa3ab666-c39e-4a11-ba44-5adbcf2c9018 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:53.148706 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-aa3ab666-c39e-4a11-ba44-5adbcf2c9018 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1218 microversion: 2.1 time: 0.065425 Jan 26 19:37:53.149526 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 717/1417] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:53 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:54.166784 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:54.167396 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:54.173313 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:54.173749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:54.174576 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:54.175005 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:54.247888 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:54.255013 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-80bf9a3f-613d-40b5-9dc3-b513accb4f2f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1276 microversion: 2.1 time: 0.092893 Jan 26 19:37:54.257056 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 701/1418] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:54 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:55.241459 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-603e7e2f-394e-4dc9-9b08-4e3fcb28dc67 req-887b9faf-d076-4d5d-821c-eb902a4335f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae117b3-304e-4d7f-b536-b45cb3ce9bfb", "tag": "e57fb035-c5bc-4ae8-b0e5-fb43d317323f"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:37:55.242982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:37:55.242982 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:37:55.253122 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-603e7e2f-394e-4dc9-9b08-4e3fcb28dc67 req-887b9faf-d076-4d5d-821c-eb902a4335f1 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:55.253562 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-603e7e2f-394e-4dc9-9b08-4e3fcb28dc67 req-887b9faf-d076-4d5d-821c-eb902a4335f1 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:55.264616 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-603e7e2f-394e-4dc9-9b08-4e3fcb28dc67 req-887b9faf-d076-4d5d-821c-eb902a4335f1 service nova] Creating event network-changed:e57fb035-c5bc-4ae8-b0e5-fb43d317323f for instance aae117b3-304e-4d7f-b536-b45cb3ce9bfb on hv-cinder-79400 Jan 26 19:37:55.273407 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:55.274455 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:55.274624 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-603e7e2f-394e-4dc9-9b08-4e3fcb28dc67 req-887b9faf-d076-4d5d-821c-eb902a4335f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036444 Jan 26 19:37:55.275389 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 718/1419] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:37:55.281626 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:55.282077 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:55.282869 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:55.283295 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:55.471140 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:55.478803 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b6137caa-1adb-415e-be83-5cbd007dcb5f tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.209955 Jan 26 19:37:55.479374 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 702/1420] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:55 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:56.496802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:56.497498 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:56.503749 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:56.504335 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:56.505129 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:56.505558 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:56.630410 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:56.638127 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-5693d07e-b485-47aa-849e-9f23c68c8db9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.146403 Jan 26 19:37:56.638688 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 719/1421] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:56 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:57.655201 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:57.655751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:57.661982 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:57.662420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:57.663180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:57.663602 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:57.793430 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:57.800572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a2e946f4-55d4-460a-ac52-a46536dc575c tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.149119 Jan 26 19:37:57.801132 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 703/1422] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:57 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:58.816770 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:58.817372 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:58.823566 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:58.824039 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:58.824793 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:58.825217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:58.948394 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:37:58.955470 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-6a4e9326-3c8b-4904-9fd3-824651df6634 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.142333 Jan 26 19:37:58.956058 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 720/1423] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:58 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:37:59.972570 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:37:59.973203 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:37:59.979973 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:59.980418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:37:59.981188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:37:59.981618 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:00.104783 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:00.111806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-884fa9e9-e511-4cbe-8586-a43c588c0642 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.142871 Jan 26 19:38:00.112384 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 704/1424] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:37:59 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:01.128283 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:01.128894 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:01.135678 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:01.136155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:01.136935 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:01.137373 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:01.269147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:01.276952 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-a67f5e07-9024-44be-9d9b-9b5bd125d5f3 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.152279 Jan 26 19:38:01.277530 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 721/1425] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:01 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:01.284842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-9dd42443-0713-4f2e-b4fe-206ecd4b155b req-a9c2748c-3027-441a-aae5-c896ca6a1521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae117b3-304e-4d7f-b536-b45cb3ce9bfb", "name": "network-vif-plugged", "status": "completed", "tag": "e57fb035-c5bc-4ae8-b0e5-fb43d317323f"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:01.288174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:38:01.288174 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:38:01.296824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9dd42443-0713-4f2e-b4fe-206ecd4b155b req-a9c2748c-3027-441a-aae5-c896ca6a1521 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:01.297305 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9dd42443-0713-4f2e-b4fe-206ecd4b155b req-a9c2748c-3027-441a-aae5-c896ca6a1521 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:01.309144 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-9dd42443-0713-4f2e-b4fe-206ecd4b155b req-a9c2748c-3027-441a-aae5-c896ca6a1521 service nova] Creating event network-vif-plugged:e57fb035-c5bc-4ae8-b0e5-fb43d317323f for instance aae117b3-304e-4d7f-b536-b45cb3ce9bfb on hv-cinder-79400 Jan 26 19:38:01.314073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-9dd42443-0713-4f2e-b4fe-206ecd4b155b req-a9c2748c-3027-441a-aae5-c896ca6a1521 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033219 Jan 26 19:38:01.314664 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 705/1426] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:02.293497 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:02.294101 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:02.300583 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:02.301029 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:02.301805 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:02.302235 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:02.427125 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:02.434754 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-34bbf774-4eb1-48ca-b62a-0b92f19be253 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1318 microversion: 2.1 time: 0.145012 Jan 26 19:38:02.435328 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 722/1427] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:02 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:03.451700 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:03.452418 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:03.458838 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:03.459279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:03.460079 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:03.460509 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:03.590473 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:03.597677 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0fc7a9cf-bd69-46cc-a89b-9606f86c2be9 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1508 microversion: 2.1 time: 0.149924 Jan 26 19:38:03.598243 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 706/1428] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:03 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:04.901780 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb965ecd-e0c3-4023-9c58-a41e0904ea49"}} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:04.902882 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:04.909128 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:04.909575 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:04.910340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:04.910772 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:05.145789 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-73297d05-8a80-4657-aa84-ea732e25fe61 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "POST /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247819 Jan 26 19:38:05.146670 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 723/1429] 10.222.0.50 () {60 vars in 1322 bytes} [Wed Jan 26 19:38:04 2022] POST /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:12.678667 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:12.679184 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:12.685315 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:12.685755 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:12.686520 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:12.686948 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:12.764496 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lazy-loading 'services' on Instance uuid aae117b3-304e-4d7f-b536-b45cb3ce9bfb {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:38:12.835171 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9580a3b8-eca0-40d8-9e99-0e2745e00605 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments/fb965ecd-e0c3-4023-9c58-a41e0904ea49" status: 202 len: 0 microversion: 2.1 time: 0.160074 Jan 26 19:38:12.835763 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 707/1430] 10.222.0.50 () {58 vars in 1415 bytes} [Wed Jan 26 19:38:12 2022] DELETE /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments/fb965ecd-e0c3-4023-9c58-a41e0904ea49 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:38:12.845445 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:12.846433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:12.852512 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:12.852967 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:12.853774 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:12.854206 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:12.886746 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-4b622281-2739-4179-9442-a65cf2d3a825 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Jan 26 19:38:12.887112 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 724/1431] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:38:12 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:13.897995 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:13.898923 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:13.905760 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:13.906202 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:13.906972 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:13.907402 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:13.935192 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b312dc76-59e1-4e3b-9721-f167eb25ec52 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041791 Jan 26 19:38:13.935737 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 708/1432] 10.222.0.50 () {58 vars in 1301 bytes} [Wed Jan 26 19:38:13 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 26 19:38:15.109590 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:15.110083 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:15.116228 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:15.116673 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:15.117432 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:15.117859 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:15.141736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:38:15.217607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-c61df6f9-33ea-4450-b324-c64fb0a2924b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 204 len: 0 microversion: 2.1 time: 0.111333 Jan 26 19:38:15.218196 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 725/1433] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:38:15 2022] DELETE /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:38:15.226933 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:15.227535 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:15.234393 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:15.234835 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:15.235601 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:15.236082 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:15.361621 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:15.368890 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3c1a156b-b071-44d8-b30d-4535852700bd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1514 microversion: 2.1 time: 0.146388 Jan 26 19:38:15.369459 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 709/1434] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:15 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:38:16.386123 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:16.386828 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:16.393167 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:16.393618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:16.394401 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:16.394842 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:16.525424 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:16.532751 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-e4d490aa-d35d-4434-8268-9affed218dd8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1514 microversion: 2.1 time: 0.150680 Jan 26 19:38:16.533316 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 726/1435] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:16 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:17.549931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:17.550538 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:17.557534 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:17.557984 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:17.558765 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:17.559197 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:17.779394 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:17.789583 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-026814b3-3d70-4d39-9199-0034a7117ffd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 200 len: 1514 microversion: 2.1 time: 0.243386 Jan 26 19:38:17.790182 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 710/1436] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:17 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:17.944635 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-a09b1db3-cac3-4a0c-9c23-b1152c449a4e req-28050c56-63a3-4565-8d58-5c1a0fd17847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae117b3-304e-4d7f-b536-b45cb3ce9bfb", "name": "network-vif-deleted", "tag": "e57fb035-c5bc-4ae8-b0e5-fb43d317323f"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:17.946986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:38:17.946986 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:38:17.955095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-a09b1db3-cac3-4a0c-9c23-b1152c449a4e req-28050c56-63a3-4565-8d58-5c1a0fd17847 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:17.955615 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-a09b1db3-cac3-4a0c-9c23-b1152c449a4e req-28050c56-63a3-4565-8d58-5c1a0fd17847 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:17.968345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-a09b1db3-cac3-4a0c-9c23-b1152c449a4e req-28050c56-63a3-4565-8d58-5c1a0fd17847 service nova] Creating event network-vif-deleted:e57fb035-c5bc-4ae8-b0e5-fb43d317323f for instance aae117b3-304e-4d7f-b536-b45cb3ce9bfb on hv-cinder-79400 Jan 26 19:38:17.973671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-a09b1db3-cac3-4a0c-9c23-b1152c449a4e req-28050c56-63a3-4565-8d58-5c1a0fd17847 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 Jan 26 19:38:17.974277 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 727/1437] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:18.807806 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:18.808403 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: aae117b3-304e-4d7f-b536-b45cb3ce9bfb] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:18.814805 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:18.815259 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:18.816073 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:18.816510 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:18.832222 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Instance aae117b3-304e-4d7f-b536-b45cb3ce9bfb could not be found. Jan 26 19:38:18.832953 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 404 to user: Instance aae117b3-304e-4d7f-b536-b45cb3ce9bfb could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:38:18.833790 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8fbc8bac-a684-43a4-b383-0d10deebd0cd tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb" status: 404 len: 111 microversion: 2.1 time: 0.031006 Jan 26 19:38:18.834724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 711/1438] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:18 2022] GET /compute/v2.1/servers/aae117b3-304e-4d7f-b536-b45cb3ce9bfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:38:19.960013 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:19.960594 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:19.967248 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:19.967708 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:19.968504 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:19.968936 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:19.992629 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:38:20.063155 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-b6ec67fc-d465-459e-94b1-04f9facc79cb tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 204 len: 0 microversion: 2.1 time: 0.107345 Jan 26 19:38:20.063985 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 728/1439] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:38:19 2022] DELETE /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:38:20.071582 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:20.072224 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:20.078918 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:20.079360 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:20.080159 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:20.080587 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:20.445997 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:20.453752 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-54e7cd25-482d-4c50-99a3-04d6fa6c86e1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1515 microversion: 2.1 time: 0.385859 Jan 26 19:38:20.454324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 712/1440] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:20 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:21.471061 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:21.471746 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:21.477928 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:21.478376 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:21.479139 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:21.479564 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:21.612070 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:21.619309 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-f8814638-8285-46d4-8a4a-dd7604b6116b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1515 microversion: 2.1 time: 0.152252 Jan 26 19:38:21.619933 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 729/1441] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:21 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:22.570538 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-47027e28-6222-4bc1-892d-c502de0178b7 req-09b8e748-be96-492a-81fc-9a429e7e2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eecef0f-f964-4d98-a685-678c4c35fc64", "name": "network-vif-deleted", "tag": "d91d131a-61eb-43aa-89a3-031afce1b712"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:22.574283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:38:22.574283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:38:22.581796 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-47027e28-6222-4bc1-892d-c502de0178b7 req-09b8e748-be96-492a-81fc-9a429e7e2ffe service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:22.582325 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-47027e28-6222-4bc1-892d-c502de0178b7 req-09b8e748-be96-492a-81fc-9a429e7e2ffe service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:22.593883 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-47027e28-6222-4bc1-892d-c502de0178b7 req-09b8e748-be96-492a-81fc-9a429e7e2ffe service nova] Creating event network-vif-deleted:d91d131a-61eb-43aa-89a3-031afce1b712 for instance 4eecef0f-f964-4d98-a685-678c4c35fc64 on hv-cinder-79400 Jan 26 19:38:22.599711 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-47027e28-6222-4bc1-892d-c502de0178b7 req-09b8e748-be96-492a-81fc-9a429e7e2ffe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032768 Jan 26 19:38:22.600868 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 713/1442] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:22.635227 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:22.636554 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:22.649198 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:22.650267 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:22.652181 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:22.653618 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:22.722845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:22.733501 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9ca772a3-9b39-41e0-8a97-31b1cb0dfe1b tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 200 len: 1303 microversion: 2.1 time: 0.101786 Jan 26 19:38:22.734258 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 730/1443] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:22 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:23.751969 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:23.752606 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 4eecef0f-f964-4d98-a685-678c4c35fc64] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:23.758653 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.759097 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:23.759903 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.760337 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:23.773230 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Instance 4eecef0f-f964-4d98-a685-678c4c35fc64 could not be found. Jan 26 19:38:23.773811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 404 to user: Instance 4eecef0f-f964-4d98-a685-678c4c35fc64 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:38:23.774889 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-46eb4bd4-43fc-4f72-8339-a6b26f0b0b13 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64" status: 404 len: 111 microversion: 2.1 time: 0.027456 Jan 26 19:38:23.775441 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 714/1444] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:23 2022] GET /compute/v2.1/servers/4eecef0f-f964-4d98-a685-678c4c35fc64 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:38:23.784838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:23.785539 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:23.795415 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.796116 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:23.797301 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.797972 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:23.825636 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:38:23.895660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-19ea09b9-3923-4ea7-912e-26354adf8743 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 204 len: 0 microversion: 2.1 time: 0.115838 Jan 26 19:38:23.896357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 731/1445] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:38:23 2022] DELETE /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:38:23.904397 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:23.904996 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:23.910749 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.911190 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:23.911992 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:23.912420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:24.035644 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:24.043328 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c504df2d-02a8-4bbb-8605-a0ba81cc80c5 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1514 microversion: 2.1 time: 0.142590 Jan 26 19:38:24.043907 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 715/1446] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:23 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:25.060053 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:25.060740 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:25.066865 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:25.067306 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:25.068093 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:25.068521 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:25.425707 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:25.433799 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-7648eb17-ca2b-4ae8-bd4a-394a464ee3b8 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1514 microversion: 2.1 time: 0.378275 Jan 26 19:38:25.435845 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 732/1447] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:25 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:26.064777 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-5d2600b7-a429-46cf-b181-0419ce08b4a5 req-fbadd879-ed37-4fe7-aabc-48ef404e73ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6a62b3-b85b-4d4a-8559-aa29f3668072", "name": "network-vif-deleted", "tag": "2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:26.066119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:38:26.066119 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:38:26.073914 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5d2600b7-a429-46cf-b181-0419ce08b4a5 req-fbadd879-ed37-4fe7-aabc-48ef404e73ab service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:26.074370 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5d2600b7-a429-46cf-b181-0419ce08b4a5 req-fbadd879-ed37-4fe7-aabc-48ef404e73ab service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:26.085585 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-5d2600b7-a429-46cf-b181-0419ce08b4a5 req-fbadd879-ed37-4fe7-aabc-48ef404e73ab service nova] Creating event network-vif-deleted:2ad8f4cb-64d6-44c1-8eb9-5549f3aa58b1 for instance 8d6a62b3-b85b-4d4a-8559-aa29f3668072 on hv-cinder-79400 Jan 26 19:38:26.091039 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-5d2600b7-a429-46cf-b181-0419ce08b4a5 req-fbadd879-ed37-4fe7-aabc-48ef404e73ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030031 Jan 26 19:38:26.091669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 716/1448] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:38:26.450700 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:26.451426 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:26.457659 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:26.458108 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:26.458904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:26.459299 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:26.490619 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:26.491062 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:26.491510 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.objects.instance [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lazy-loading 'fault' on Instance uuid 8d6a62b3-b85b-4d4a-8559-aa29f3668072 {{(pid=116106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 26 19:38:26.532711 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:26.540265 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-32c0bba6-11e5-491f-bfdd-65f94e8b8548 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 200 len: 1307 microversion: 2.1 time: 0.093799 Jan 26 19:38:26.540857 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 733/1449] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:26 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:27.557851 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:27.558541 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 8d6a62b3-b85b-4d4a-8559-aa29f3668072] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:27.564630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:27.565078 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:27.565852 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:27.566283 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:27.580347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Instance 8d6a62b3-b85b-4d4a-8559-aa29f3668072 could not be found. Jan 26 19:38:27.580936 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 404 to user: Instance 8d6a62b3-b85b-4d4a-8559-aa29f3668072 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:38:27.581771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4a468733-0932-4262-91ea-0ca085bbcb20 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072" status: 404 len: 111 microversion: 2.1 time: 0.028424 Jan 26 19:38:27.582347 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 717/1450] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:27 2022] GET /compute/v2.1/servers/8d6a62b3-b85b-4d4a-8559-aa29f3668072 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:38:28.568992 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:38:28.569572 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:38:28.705944 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:28.706434 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:28.712699 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:28.713147 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:28.714403 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:28.714836 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:28.739356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:38:28.817340 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-62e6e4fa-3e4a-41a7-9380-cf931cc1e57a tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "DELETE /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 204 len: 0 microversion: 2.1 time: 0.114720 Jan 26 19:38:28.817987 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 734/1451] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:38:28 2022] DELETE /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:38:28.828683 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:28.829753 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:28.837180 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:28.837630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:28.838928 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:28.839366 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:28.965566 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:28.972811 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-af097781-5655-4701-8d00-5667d9a1e708 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1513 microversion: 2.1 time: 0.150563 Jan 26 19:38:28.973375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 718/1452] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:28 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:38:29.908885 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:38:29.909414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:38:29.990094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:29.990782 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:29.997762 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:29.998344 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:29.999213 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:29.999736 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:30.125106 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:30.132310 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-611ee65a-ba80-4d06-8ac7-03e733ac2de1 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1513 microversion: 2.1 time: 0.146218 Jan 26 19:38:30.132873 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 735/1453] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:29 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:38:31.148663 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:31.149279 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:31.155842 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:31.156290 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:31.157054 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:31.157480 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:31.370450 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6337c5b93393443d8dee2ff6c7b0a121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b7093fc6044e2dbc5ec6163648ea14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:38:31.377732 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c45ac2d3-5329-4ffa-9a72-c08c111209f0 tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 200 len: 1513 microversion: 2.1 time: 0.232779 Jan 26 19:38:31.378377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 719/1454] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:31 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:38:31.401756 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [req-de34dd7b-30fd-423c-ab44-4627d18bf54d req-7090139e-d31d-4923-9f20-0f1943272764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626669d2-1559-4ee3-a821-5700455c065b", "name": "network-vif-deleted", "tag": "d7374057-ff0b-46c0-97e2-544a3f54a28d"}]} {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:38:31.403641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:38:31.403641 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: warnings.warn(msg) Jan 26 19:38:31.412420 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-de34dd7b-30fd-423c-ab44-4627d18bf54d req-7090139e-d31d-4923-9f20-0f1943272764 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:31.412870 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [req-de34dd7b-30fd-423c-ab44-4627d18bf54d req-7090139e-d31d-4923-9f20-0f1943272764 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:31.424947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.compute.server_external_events [req-de34dd7b-30fd-423c-ab44-4627d18bf54d req-7090139e-d31d-4923-9f20-0f1943272764 service nova] Creating event network-vif-deleted:d7374057-ff0b-46c0-97e2-544a3f54a28d for instance 626669d2-1559-4ee3-a821-5700455c065b on hv-cinder-79400 Jan 26 19:38:31.429877 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [req-de34dd7b-30fd-423c-ab44-4627d18bf54d req-7090139e-d31d-4923-9f20-0f1943272764 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Jan 26 19:38:31.430456 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 736/1455] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 26 19:38:32.394246 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:38:32.394849 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] [instance: 626669d2-1559-4ee3-a821-5700455c065b] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:38:32.401377 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:32.401824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:32.402600 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:38:32.403033 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:38:32.415733 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] HTTP exception thrown: Instance 626669d2-1559-4ee3-a821-5700455c065b could not be found. Jan 26 19:38:32.416336 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] Returning 404 to user: Instance 626669d2-1559-4ee3-a821-5700455c065b could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:38:32.417152 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6a53fb50-8f2c-4467-af76-8c1a425ea0ea tempest-AttachVolumeNegativeTest-761336682 tempest-AttachVolumeNegativeTest-761336682-project] 10.222.0.50 "GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b" status: 404 len: 111 microversion: 2.1 time: 0.026725 Jan 26 19:38:32.417669 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 720/1456] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:38:32 2022] GET /compute/v2.1/servers/626669d2-1559-4ee3-a821-5700455c065b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:39:29.269838 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:29.270399 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:29.271375 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-0aef6b80-84b3-41c8-9265-474b36e612ef req-b94bc1df-05c0-469e-81c2-4ea3535d38c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0131be9-22c7-43ff-83aa-ee8fef26df82", "tag": "2fd42577-2df6-46e5-b3c1-d7513432947d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:39:29.273096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:39:29.273096 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:39:29.277051 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:29.277502 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:29.278276 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:29.278705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:29.281188 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-0aef6b80-84b3-41c8-9265-474b36e612ef req-b94bc1df-05c0-469e-81c2-4ea3535d38c6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:29.281709 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-0aef6b80-84b3-41c8-9265-474b36e612ef req-b94bc1df-05c0-469e-81c2-4ea3535d38c6 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:29.294486 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-0aef6b80-84b3-41c8-9265-474b36e612ef req-b94bc1df-05c0-469e-81c2-4ea3535d38c6 service nova] Creating event network-changed:2fd42577-2df6-46e5-b3c1-d7513432947d for instance f0131be9-22c7-43ff-83aa-ee8fef26df82 on hv-cinder-79400 Jan 26 19:39:29.301258 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-0aef6b80-84b3-41c8-9265-474b36e612ef req-b94bc1df-05c0-469e-81c2-4ea3535d38c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Jan 26 19:39:29.302420 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 721/1457] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:39:29.306455 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:39:29.396253 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-53068d3e-9516-4065-9b5e-02f6564f84aa tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 204 len: 0 microversion: 2.1 time: 0.131053 Jan 26 19:39:29.397102 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 737/1458] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:39:29 2022] DELETE /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:39:29.406619 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:29.407464 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:29.413735 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:29.414324 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:29.415200 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:29.415630 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:29.621572 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:39:29.629426 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1bb34e6b-6fdc-411d-af34-932e373f0800 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1578 microversion: 2.1 time: 0.227749 Jan 26 19:39:29.629998 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 722/1459] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:29 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:39:30.646742 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:30.647357 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:30.653904 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:30.654345 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:30.655109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:30.655542 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:30.788887 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:39:30.796895 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-dfa3805c-942c-4b71-b73e-374c2866cae8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1459 microversion: 2.1 time: 0.154253 Jan 26 19:39:30.797462 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 738/1460] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:30 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:39:31.701173 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f3ba8784-d81f-41ef-a716-67adb7c03a5e req-8f521484-e760-452d-9fb3-e0c5bf5b2b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0131be9-22c7-43ff-83aa-ee8fef26df82", "name": "network-vif-deleted", "tag": "2fd42577-2df6-46e5-b3c1-d7513432947d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:39:31.703327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:39:31.703327 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:39:31.711294 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f3ba8784-d81f-41ef-a716-67adb7c03a5e req-8f521484-e760-452d-9fb3-e0c5bf5b2b81 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:31.711800 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f3ba8784-d81f-41ef-a716-67adb7c03a5e req-8f521484-e760-452d-9fb3-e0c5bf5b2b81 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:31.723360 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f3ba8784-d81f-41ef-a716-67adb7c03a5e req-8f521484-e760-452d-9fb3-e0c5bf5b2b81 service nova] Creating event network-vif-deleted:2fd42577-2df6-46e5-b3c1-d7513432947d for instance f0131be9-22c7-43ff-83aa-ee8fef26df82 on hv-cinder-79400 Jan 26 19:39:31.728215 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f3ba8784-d81f-41ef-a716-67adb7c03a5e req-8f521484-e760-452d-9fb3-e0c5bf5b2b81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030666 Jan 26 19:39:31.728807 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 723/1461] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:39:31.813559 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:31.814164 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:31.820647 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:31.821094 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:31.821959 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:31.822356 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:31.880492 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:39:31.887617 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-ab2ac3dd-e233-4dd8-8373-4b0e1e20c9c0 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 200 len: 1226 microversion: 2.1 time: 0.078319 Jan 26 19:39:31.888215 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 739/1462] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:31 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:39:32.905862 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:32.906543 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: f0131be9-22c7-43ff-83aa-ee8fef26df82] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:32.912579 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:32.913023 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:32.913783 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:32.914213 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:32.926874 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] HTTP exception thrown: Instance f0131be9-22c7-43ff-83aa-ee8fef26df82 could not be found. Jan 26 19:39:32.927442 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Returning 404 to user: Instance f0131be9-22c7-43ff-83aa-ee8fef26df82 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:39:32.928264 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-81fb4759-5bf2-45f4-ad9a-4d7a5e300603 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82" status: 404 len: 111 microversion: 2.1 time: 0.027741 Jan 26 19:39:32.928771 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 724/1463] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:32 2022] GET /compute/v2.1/servers/f0131be9-22c7-43ff-83aa-ee8fef26df82 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:39:35.969250 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:35.969796 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:35.972830 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-59bc8604-5242-413a-96c3-f83a79a6e8e4 req-67736621-112e-4ac5-8d72-fe0a0b007508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66438316-cd90-4e4e-8b90-d7dcb5096bbf", "tag": "82e3bf1e-e1f0-4be5-9e65-ff038e41aee2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:39:35.974428 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:39:35.974428 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:39:35.981736 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-59bc8604-5242-413a-96c3-f83a79a6e8e4 req-67736621-112e-4ac5-8d72-fe0a0b007508 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:35.982271 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-59bc8604-5242-413a-96c3-f83a79a6e8e4 req-67736621-112e-4ac5-8d72-fe0a0b007508 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:35.985405 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:35.985947 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:35.986874 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:35.987375 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:35.993490 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-59bc8604-5242-413a-96c3-f83a79a6e8e4 req-67736621-112e-4ac5-8d72-fe0a0b007508 service nova] Creating event network-changed:82e3bf1e-e1f0-4be5-9e65-ff038e41aee2 for instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf on hv-cinder-79400 Jan 26 19:39:35.999043 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-59bc8604-5242-413a-96c3-f83a79a6e8e4 req-67736621-112e-4ac5-8d72-fe0a0b007508 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029821 Jan 26 19:39:35.999724 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 725/1464] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:39:36.017613 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Going to try to terminate instance {{(pid=116106) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 26 19:39:36.099048 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-12a06dbb-7a0b-41a0-b01f-389a2dbad36c tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "DELETE /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 204 len: 0 microversion: 2.1 time: 0.132927 Jan 26 19:39:36.099581 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 740/1465] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:39:35 2022] DELETE /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 26 19:39:36.108120 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:36.108814 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:36.115502 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:36.115976 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:36.116756 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:36.117184 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:36.360392 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:39:36.371483 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-76674376-8e3f-44d5-80b9-7f3674a983dc tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1578 microversion: 2.1 time: 0.267427 Jan 26 19:39:36.372095 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 726/1466] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:36 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 26 19:39:37.390052 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:37.390745 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:37.396880 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:37.397318 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:37.398095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:37.398524 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:37.458390 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.policy [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477b689bf5c0415aa7eba64b81d8602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4fb0a5c0e74ac8bfc5dd910bac07f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116106) authorize /opt/stack/nova/nova/policy.py:199}} Jan 26 19:39:37.465671 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-9a6a5e77-cdd2-4e6a-93da-f06cb16ea766 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 200 len: 1226 microversion: 2.1 time: 0.080196 Jan 26 19:39:37.466428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 741/1467] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:37 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 26 19:39:38.013414 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-a96d216e-6231-4f10-939e-58fffec21b3b req-533804f6-7699-49b8-8838-d384c06b50a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66438316-cd90-4e4e-8b90-d7dcb5096bbf", "name": "network-vif-deleted", "tag": "82e3bf1e-e1f0-4be5-9e65-ff038e41aee2"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 26 19:39:38.014966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 26 19:39:38.014966 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Jan 26 19:39:38.022177 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a96d216e-6231-4f10-939e-58fffec21b3b req-533804f6-7699-49b8-8838-d384c06b50a8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.022623 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a96d216e-6231-4f10-939e-58fffec21b3b req-533804f6-7699-49b8-8838-d384c06b50a8 service nova] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.033268 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-a96d216e-6231-4f10-939e-58fffec21b3b req-533804f6-7699-49b8-8838-d384c06b50a8 service nova] Creating event network-vif-deleted:82e3bf1e-e1f0-4be5-9e65-ff038e41aee2 for instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf on hv-cinder-79400 Jan 26 19:39:38.037950 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-a96d216e-6231-4f10-939e-58fffec21b3b req-533804f6-7699-49b8-8838-d384c06b50a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028213 Jan 26 19:39:38.038508 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 727/1468] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Jan 26 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 26 19:39:38.482171 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:38.483287 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 66438316-cd90-4e4e-8b90-d7dcb5096bbf] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:38.489466 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.489908 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.490668 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.491095 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.503801 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] HTTP exception thrown: Instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf could not be found. Jan 26 19:39:38.504363 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Returning 404 to user: Instance 66438316-cd90-4e4e-8b90-d7dcb5096bbf could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:39:38.505151 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-569f0499-617e-4e3c-8e0d-bf7fe15b6471 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf" status: 404 len: 111 microversion: 2.1 time: 0.026862 Jan 26 19:39:38.505660 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 742/1469] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:38 2022] GET /compute/v2.1/servers/66438316-cd90-4e4e-8b90-d7dcb5096bbf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:39:38.939931 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:38.940511 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:38.946530 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.946977 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.947751 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.948208 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.961423 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] HTTP exception thrown: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. Jan 26 19:39:38.961999 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Returning 404 to user: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:39:38.962833 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9cdda0b1-19e3-4b50-aad7-39aadc405948 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 404 len: 111 microversion: 2.1 time: 0.027484 Jan 26 19:39:38.963353 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 728/1470] 10.222.0.50 () {58 vars in 1238 bytes} [Wed Jan 26 19:39:38 2022] DELETE /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:39:38.971109 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '>' {{(pid=116106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:38.971719 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.compute.api [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] [instance: 4086ab6e-4b96-40f9-bb16-220b75880976] Fetching instance by UUID {{(pid=116106) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 26 19:39:38.977409 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.977851 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.978607 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 26 19:39:38.979035 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG oslo_concurrency.lockutils [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Lock "997dbb52-70f5-4978-b985-21ab6ca12bcd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 26 19:39:38.993872 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.wsgi [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] HTTP exception thrown: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. Jan 26 19:39:38.994433 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: DEBUG nova.api.openstack.wsgi [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Returning 404 to user: Instance 4086ab6e-4b96-40f9-bb16-220b75880976 could not be found. {{(pid=116106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 26 19:39:38.995217 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO nova.api.openstack.requestlog [None req-358f3ecb-1491-4856-9b48-bd2656a33fd8 tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976" status: 404 len: 111 microversion: 2.1 time: 0.027791 Jan 26 19:39:38.995752 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: [pid: 116106|app: 0|req: 743/1471] 10.222.0.50 () {58 vars in 1235 bytes} [Wed Jan 26 19:39:38 2022] GET /compute/v2.1/servers/4086ab6e-4b96-40f9-bb16-220b75880976 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 26 19:39:40.276358 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f984aaeb-7fa7-41d6-ace4-922bcfc081db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] Calling method '.version_select at 0x7fb7c0db0f70>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 26 19:39:40.301428 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f984aaeb-7fa7-41d6-ace4-922bcfc081db tempest-TestVolumeBootPattern-1110503724 tempest-TestVolumeBootPattern-1110503724-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1429712429" status: 202 len: 0 microversion: 2.1 time: 0.028981 Jan 26 19:39:40.302011 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 729/1472] 10.222.0.50 () {58 vars in 1262 bytes} [Wed Jan 26 19:39:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1429712429 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 26 19:40:18.333431 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:40:18.334036 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:41:48.576802 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:41:48.577511 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:43:19.841239 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:43:19.841854 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:43:38.341428 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:43:38.341964 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:43:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:45:08.584705 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:45:08.585360 dv-cinder-794001-3-iscsi devstack@n-api.service[116106]: Wed Jan 26 19:45:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 26 19:45:09.920245 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 26 19:45:09.920824 dv-cinder-794001-3-iscsi devstack@n-api.service[116105]: Wed Jan 26 19:45:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!